Basic Probability - Important Notes
Introduction to Probability
Probability is a branch of mathematics that deals with uncertainty and chance. It provides a
systematic way of measuring the likelihood of different outcomes. The concept of probability is
widely used in science, engineering, economics, data analysis, and daily decision-making.
Basic Terms
1. Experiment: An action or process that leads to one or several outcomes. Example: tossing a
coin.
2. Sample Space (S): The set of all possible outcomes. Example: For a coin toss, S = {Head, Tail}.
3. Event: A subset of the sample space. Example: Getting a Head when tossing a coin.
4. Random Variable: A variable whose value is determined by the outcome of a random
experiment.
5. Probability of an Event (P(E)): The measure of how likely an event is to occur, calculated as: P(E)
= (Number of favorable outcomes) / (Total number of outcomes).
Rules of Probability
1. The probability of any event lies between 0 and 1.
2. P(S) = 1, where S is the sample space.
3. The probability of the impossible event (∅) is 0.
4. If two events A and B are mutually exclusive, then P(A ∪ B) = P(A) + P(B).
5. Complementary Rule: P(A') = 1 - P(A).
Types of Probability
1. Theoretical Probability: Based on reasoning and known facts.
2. Experimental Probability: Based on observations and experiments.
3. Subjective Probability: Based on intuition, opinion, or experience.
Conditional Probability
Conditional probability refers to the probability of an event occurring given that another event has
already occurred. It is written as P(A|B) and is calculated as:
P(A|B) = P(A ∩ B) / P(B), provided that P(B) > 0.
Independent and Dependent Events
- Independent: Events A and B are independent if the occurrence of one does not affect the
occurrence of the other. For independent events, P(A ∩ B) = P(A) * P(B).
- Dependent: Events where one event affects the probability of the other.
Bayes' Theorem
Bayes' Theorem provides a way to revise existing probabilities given new evidence. It is written as:
P(A|B) = [P(B|A) * P(A)] / P(B)
This theorem is widely used in machine learning, data science, and statistics.
Applications of Probability
1. Weather forecasting.
2. Insurance and risk management.
3. Quality control in industries.
4. Medical testing and diagnosis.
5. Gambling, games, and sports analysis.
6. Artificial Intelligence and Machine Learning.
Examples
1. Tossing 2 coins: Sample space = {HH, HT, TH, TT}. Probability of exactly one head = 2/4 = 1/2.
2. Rolling a die: Probability of getting an even number = 3/6 = 1/2.
3. Drawing a card from a standard deck: Probability of getting a heart = 13/52 = 1/4.
Conclusion
Probability is a fundamental mathematical tool that helps us deal with uncertainty. From everyday
life to advanced scientific research, probability enables us to make informed decisions and
predictions. Mastering probability concepts such as sample space, events, conditional probability,
and Bayes’ theorem provides a strong foundation for further study in statistics, data science, and
computer science.