Chapter 1. Probability
Chapter 1. Probability
March 2, 2026
Nguyễn Hoàng Huy Tú (Forgein Trade University HCM Campus) Probability March 2, 2026 1 / 56
Introduction to Probability Theory
RANDOMNESS
Nguyễn Hoàng Huy Tú (Forgein Trade University HCM Campus) Probability March 2, 2026 1 / 56
Motivation
Nguyễn Hoàng Huy Tú (Forgein Trade University HCM Campus) Probability March 2, 2026 2 / 56
Key Term
Nguyễn Hoàng Huy Tú (Forgein Trade University HCM Campus) Probability March 2, 2026 3 / 56
Idea
Even in Randomness, there exists some pattern that is not purely random.
Nguyễn Hoàng Huy Tú (Forgein Trade University HCM Campus) Probability March 2, 2026 4 / 56
Example
Example: Tossing a coin.
Nguyễn Hoàng Huy Tú (Forgein Trade University HCM Campus) Probability March 2, 2026 5 / 56
Example
Nguyễn Hoàng Huy Tú (Forgein Trade University HCM Campus) Probability March 2, 2026 6 / 56
Learning Objectives
What is probability?
Nguyễn Hoàng Huy Tú (Forgein Trade University HCM Campus) Probability March 2, 2026 7 / 56
1.1. Basic Definitions Random Experiment and Sample Space
Random Experiment
Definition
A random experiment is a process that can lead to two or more possible outcomes,
without knowing in advance which outcome will occur.
Examples:
A coin is tossed; the outcome is either a head or a tail.
The number of persons admitted to a hospital emergency room during any hour
cannot be known in advance.
A customer enters a store and either purchases a shirt or does not.
Nguyễn Hoàng Huy Tú (Forgein Trade University HCM Campus) Probability March 2, 2026 8 / 56
1.1. Basic Definitions Random Experiment and Sample Space
Example: An investor follows the Dow Jones Industrial Average. There are two basic
outcomes:
O1 : The index is higher than at yesterday’s close.
O2 : The index is not higher than at yesterday’s close.
Therefore, the sample space is
S = {O1 , O2 }.
Nguyễn Hoàng Huy Tú (Forgein Trade University HCM Campus) Probability March 2, 2026 9 / 56
1.1. Basic Definitions Random Experiment and Sample Space
Exercise
Ex 1: The left hand tosses a coin and the right hand rolls a die. Describe a basic outcome
and then construct the sample space.
Ex 2: Two letters are selected from {A, B, C} and arranged in order. Describe a basic
outcome and then construct the sample space.
Nguyễn Hoàng Huy Tú (Forgein Trade University HCM Campus) Probability March 2, 2026 10 / 56
1.1. Basic Definitions Random Experiment and Sample Space
Exercise
A royal family has two children, including Prince Harry. Consider how likely it is that
Prince Harry has a sister. Which of the following is a suitable sample space?
A. S = {B, G}
B. S = {BB, BG, GB}
C. S = {HB, BH, GH, HG}
Nguyễn Hoàng Huy Tú (Forgein Trade University HCM Campus) Probability March 2, 2026 11 / 56
1.1. Basic Definitions Events
Event
Definition
An event E is any subset of basic outcomes from the sample space. An event occurs if the
random experiment results in one of its constituent basic outcomes.
A basic outcome that belongs to E is said to satisfy the event E.
The empty set 0/ is called a null event.
Example: Roll a die. Consider the event A: “The outcome is an even number.” Then the
basic outcomes that satisfy A are 2, 4, 6. Therefore,
A = {2, 4, 6}.
Nguyễn Hoàng Huy Tú (Forgein Trade University HCM Campus) Probability March 2, 2026 12 / 56
1.1. Basic Definitions Events
Intersection of Events
Definition
Let A and B be two events in the sample space S. Their intersection, denoted by A ∩ B, is
the set of all basic outcomes in S that belong to both A and B. Hence, the intersection
A ∩ B occurs if and only if both A and B occur.
In particular, if the events A and B have no common basic outcomes, that is,
A ∩ B = 0,
/
Nguyễn Hoàng Huy Tú (Forgein Trade University HCM Campus) Probability March 2, 2026 13 / 56
1.1. Basic Definitions Events
S S
A B A B
Nguyễn Hoàng Huy Tú (Forgein Trade University HCM Campus) Probability March 2, 2026 14 / 56
1.1. Basic Definitions Events
Union of Events
Definition
Let A and B be two events in the sample space S. Their union, denoted by A ∪ B, is the set
of all basic outcomes in S that belong to at least one of these two events. Hence, the
union A ∪ B occurs if and only if A or B (or both) occur.
E1 ∪ E2 ∪ · · · ∪ En = S,
Nguyễn Hoàng Huy Tú (Forgein Trade University HCM Campus) Probability March 2, 2026 15 / 56
1.1. Basic Definitions Events
S S
A B E1 E2 E3
Nguyễn Hoàng Huy Tú (Forgein Trade University HCM Campus) Probability March 2, 2026 16 / 56
1.1. Basic Definitions Events
Complement
Definition
Let A be an event in the sample space S. The set of basic outcomes that belong to S but
not to A is called the complement of A and is denoted by A.
Note that A = S \ A. Moreover, the events A and A are mutually exclusive (no basic
outcome can belong to both) and collectively exhaustive (every basic outcome belongs to
one or the other).
Complement: A = S \ A
Nguyễn Hoàng Huy Tú (Forgein Trade University HCM Campus) Probability March 2, 2026 17 / 56
1.1. Basic Definitions Events
Exercise
Ex 1: We designate four basic outcomes for the Dow Jones Industrial Average over two
consecutive days:
O1 : The average rises on both days.
O2 : The average rises on the first day but does not rise on the second day.
O3 : The average does not rise on the first day but rises on the second day.
O4 : The average does not rise on either day.
We consider two events:
A: “The average rises on the first day.”
B: “The average rises on the second day.”
Find the intersection, union, and complement of A and B.
Nguyễn Hoàng Huy Tú (Forgein Trade University HCM Campus) Probability March 2, 2026 18 / 56
1.1. Basic Definitions Events
Exercise
Ex 2: The sample space is
S = {E1 , E2 , E3 , E4 , E5 , E6 , E7 , E8 , E9 , E10 }.
Given A = {E3 , E5 , E6 , E10 } and B = {E3 , E4 , E6 , E9 }.
a. What is A ∩ B?
b. What is A ∪ B?
c. Is A ∪ B collectively exhaustive?
d. Use a Venn diagram to visualize A, B, A ∩ B, and A ∪ B.
e. Use the Venn diagram to check that A ∩ B and A ∩ B are mutually exclusive. Moreover,
A = (A ∩ B) ∪ (A ∩ B).
Nguyễn Hoàng Huy Tú (Forgein Trade University HCM Campus) Probability March 2, 2026 19 / 56
1.1. Basic Definitions Events
Exercise
Ex 3: Florin Frenti operates a small used-car lot that has three Mercedes (M1 , M2 , M3 )
and two Toyotas (T1 , T2 ). Two customers, Cezara and Anda, come to the lot, and each
selects a car. The customers do not know each other, and there is no communication
between them. Let events A and B be defined as follows:
A: The customers select at least one Toyota.
B: The customers select two cars of the same model.
a. Identify the sample space.
b. Define event A.
c. Define event B.
d. Find the intersection, union, and complement of A and B.
e. Find the intersection and union of A and B.
Nguyễn Hoàng Huy Tú (Forgein Trade University HCM Campus) Probability March 2, 2026 20 / 56
1.2. Probability Definitions
Classical Probability
Definition
Assume that all outcomes in a sample space are equally likely to occur. Then the
probability of an event A is defined by
NA
P(A) = ,
N
where
N = the total number of outcomes in the sample space.
NA = the number of outcomes that satisfy event A.
Nguyễn Hoàng Huy Tú (Forgein Trade University HCM Campus) Probability March 2, 2026 21 / 56
1.2. Probability Definitions
Example
A small computer store has three Hewlett-Packard and two Dell computers in stock.
Suppose that Susan Spencer comes to purchase two computers. Any computer on the
shelf is equally likely to be selected. What is the probability that Susan will purchase one
Hewlett-Packard and one Dell computer?
Hence
NA 6
P(A) = = .
N 10
Nguyễn Hoàng Huy Tú (Forgein Trade University HCM Campus) Probability March 2, 2026 22 / 56
1.2. Probability Definitions
x! = x(x − 1)(x − 2) · · · 2 · 1.
The number of possible ways of selecting and arranging in order x objects from n is
n!
Pnx = .
(n − x)!
Nguyễn Hoàng Huy Tú (Forgein Trade University HCM Campus) Probability March 2, 2026 23 / 56
1.2. Probability Definitions
Example
Again consider the computer store with 3 Hewlett-Packard and 2 Dell computers.
Suppose Susan Spencer purchases two computers. Any pair is equally likely to be
chosen.
NA = C31 · C21 = 6.
Therefore,
NA 6
P(A) = = .
N 10
Nguyễn Hoàng Huy Tú (Forgein Trade University HCM Campus) Probability March 2, 2026 24 / 56
1.2. Probability Definitions
Exercise
Nguyễn Hoàng Huy Tú (Forgein Trade University HCM Campus) Probability March 2, 2026 25 / 56
1.2. Probability Definitions
Exercise
Ex 2: You are 1 of 7 female candidates auditioning for 2 roles in a play: the heroine and
her best friend. All candidates are equally likely to be chosen.
Nguyễn Hoàng Huy Tú (Forgein Trade University HCM Campus) Probability March 2, 2026 26 / 56
1.2. Probability Definitions
Exercise
Ex 3: Three customers enter a bank with 6 service counters. Find the probability that:
a. All 3 customers go to the same counter. 1/36
b. Each customer goes to a different counter. 5/9
c. Exactly two of the three customers go to the same counter. 5/12
Nguyễn Hoàng Huy Tú (Forgein Trade University HCM Campus) Probability March 2, 2026 27 / 56
1.2. Probability Definitions
Definition
The relative frequency probability of event A is the limit of the proportion of times that A
occurs in a large number of trials n:
nA nA
P(A) = lim ≈ ,
n→∞ n n
where
nA is the number of times event A occurs.
n is the total number of trials.
Nguyễn Hoàng Huy Tú (Forgein Trade University HCM Campus) Probability March 2, 2026 28 / 56
1.2. Probability Definitions
Example
There were 54,345 households in City X, and 31,496 had incomes above $75,000. The
probability of event A, “family income greater than $75,000,” is
nA 31,496
P(A) = = ≈ 0.58 = 58%.
n 54,345
Nguyễn Hoàng Huy Tú (Forgein Trade University HCM Campus) Probability March 2, 2026 29 / 56
1.2. Probability Properties
Properties
Properties
i. For any event A in the sample space S,
0 ≤ P(A) ≤ 1.
P(A) = ∑ P(Oi ).
Oi ∈A
iii.
P(S) = 1, P(0)
/ = 0.
Nguyễn Hoàng Huy Tú (Forgein Trade University HCM Campus) Probability March 2, 2026 30 / 56
1.3. Probability Rules Complement Rule
Complement Rule
Rule
Let A be an event and A its complement. Then the complement rule is
P(A) = 1 − P(A).
Nguyễn Hoàng Huy Tú (Forgein Trade University HCM Campus) Probability March 2, 2026 31 / 56
1.3. Probability Rules Addition Rule
Addition Rule
Rule
Let A and B be two events. The addition rule states:
As a corollary:
If A and B are mutually exclusive, then
P(A ∪ B) = P(A) + P(B).
Example
Example 1: P(A) = 0.60, P(B) = 0.45, and P(A ∩ B) = 0.30. What is P(A ∪ B)?
Example 2: P(A) = 0.40, P(B) = 0.45, and P(A ∪ B) = 0.85. What is P(A ∩ B)?
Nguyễn Hoàng Huy Tú (Forgein Trade University HCM Campus) Probability March 2, 2026 33 / 56
1.3. Probability Rules Addition Rule
Example
Example A survey shows that 55% of students like coffee, 45% like tea, and 25% like
both.
a. What is the probability that a student likes at least one of these beverages? 0.75
b. What is the probability that a student likes coffee but not tea? 0.3
c. What is the probability that a student dislikes both tea and coffee? 0.25
Nguyễn Hoàng Huy Tú (Forgein Trade University HCM Campus) Probability March 2, 2026 34 / 56
1.3. Probability Rules Addition Rule
Exercise
Ex 1: A cell phone company found that 65% of all customers want text messaging, 70%
want photo capability, and 40% want both.
a. What is the probability that a customer wants at least one of these? 0.95
0.25
b. What is the probability that a customer wants text messaging but not photo capability?
c. What is the probability that a customer only wants photo capability? 0.3
Nguyễn Hoàng Huy Tú (Forgein Trade University HCM Campus) Probability March 2, 2026 35 / 56
1.3. Probability Rules Conditional Probability
Example
Example: Three suspects—Peter, Jack, and Mary (two men and one woman)—are
equally likely to be the murderer. Let A be the event “Peter is the murderer.”
Initially,
1
P(A) = .
3
After investigation, the police conclude that the murderer must be a man.
Nguyễn Hoàng Huy Tú (Forgein Trade University HCM Campus) Probability March 2, 2026 36 / 56
1.3. Probability Rules Conditional Probability
Conditional Probability
Definition
Let A and B be two events. The conditional probability of A given B is
P(A ∩ B)
P(A|B) = , P(B) > 0.
P(B)
Similarly,
P(A ∩ B)
P(B|A) = , P(A) > 0.
P(A)
Nguyễn Hoàng Huy Tú (Forgein Trade University HCM Campus) Probability March 2, 2026 37 / 56
1.3. Probability Rules Multiplication Rule
Multiplication Rule
Rule
For two events A and B, the multiplication rule states:
Nguyễn Hoàng Huy Tú (Forgein Trade University HCM Campus) Probability March 2, 2026 38 / 56
1.3. Probability Rules Multiplication Rule
Exercise
Ex 1: A cell phone company found that 65% of customers want text messaging, 70%
want photo capability, and 40% want both.
a. If a person wants photo capability, what is the probability they also want text
messaging?
b. If a person wants text messaging, what is the probability they also want photo
capability?
Nguyễn Hoàng Huy Tú (Forgein Trade University HCM Campus) Probability March 2, 2026 39 / 56
1.3. Probability Rules Multiplication Rule
Exercise
Ex 2: A device has 2 parts. The probability that part 1 is broken is 0.1; for part 2, it is 0.2.
The probability that both are broken is 0.04. Find the probability that:
a. At least one part works well. b. Both parts work well. c. Only part 1 works well. d.
Exactly one part works well. e. Part 1 works well, given that part 2 is broken. f. Part 1
works well, given that exactly one part is broken.
Nguyễn Hoàng Huy Tú (Forgein Trade University HCM Campus) Probability March 2, 2026 40 / 56
1.3. Probability Rules Multiplication Rule
Exercise
Nguyễn Hoàng Huy Tú (Forgein Trade University HCM Campus) Probability March 2, 2026 41 / 56
1.3. Probability Rules Multiplication Rule
Exercise
Nguyễn Hoàng Huy Tú (Forgein Trade University HCM Campus) Probability March 2, 2026 42 / 56
1.3. Probability Rules Multiplication Rule
Quick Review
Exercise 1: In a campus restaurant, 35% of customers order vegetarian meals and 50%
are students. Moreover, 25% of student customers order vegetarian meals.
a. What is the probability that a randomly chosen customer is both a student and orders a
vegetarian meal? 0.6
b. If a randomly chosen customer orders a vegetarian meal, what is the probability that
the customer is a student? 5/7
P(A|B) = 1 − P(A|B).
Nguyễn Hoàng Huy Tú (Forgein Trade University HCM Campus) Probability March 2, 2026 43 / 56
1.3. Probability Rules Statistical Independence
Statistical Independence
Definition
Two events A and B are statistically independent if
It follows that
P(A|B) = P(A) (P(B) > 0), P(B|A) = P(B) (P(A) > 0).
Nguyễn Hoàng Huy Tú (Forgein Trade University HCM Campus) Probability March 2, 2026 44 / 56
1.3. Probability Rules Statistical Independence
Example
Since
P(A)P(B) = (0.54)(0.20) = 0.108 ̸= 0.08 = P(A ∩ B),
the events are not independent.
Nguyễn Hoàng Huy Tú (Forgein Trade University HCM Campus) Probability March 2, 2026 45 / 56
1.3. Probability Rules Statistical Independence
Example
Example 2 (By nature of experiment): Tossing a fair coin two or more times. The
probability of a head on any toss remains the same and is not influenced by previous
outcomes.
Nguyễn Hoàng Huy Tú (Forgein Trade University HCM Campus) Probability March 2, 2026 46 / 56
1.3. Probability Rules Statistical Independence
Exercise
b. Are the events “problem occurs on Monday” and “problem occurs in the last hour”
independent? no
Nguyễn Hoàng Huy Tú (Forgein Trade University HCM Campus) Probability March 2, 2026 47 / 56
1.4. Bayes’ Theorem Total Probability Rule
Rule
Let E1 , E2 , . . . , En be a system of events that are both mutually exclusive and collectively
exhaustive. Let A be an event. Then
In particular, since A and A are mutually exclusive and collectively exhaustive, for any
event B we have
P(B) = P(A)P(B|A) + P(A)P(B|A).
Nguyễn Hoàng Huy Tú (Forgein Trade University HCM Campus) Probability March 2, 2026 48 / 56
1.4. Bayes’ Theorem Bayes’ Theorem
Bayes’ Theorem
Theorem
Let E1 , E2 , . . . , En be a system of events that are both mutually exclusive and collectively
exhaustive. Let A be an event. Then
P(A|Ei )P(Ei )
P(Ei |A) = ,
P(A)
or equivalently,
P(A|Ei )P(Ei )
P(Ei |A) = .
P(E1 )P(A|E1 ) + P(E2 )P(A|E2 ) + · · · + P(En )P(A|En )
In particular,
P(A)P(B|A) P(A)P(B|A)
P(A|B) = = .
P(B) P(A)P(B|A) + P(A)P(B|A)
Nguyễn Hoàng Huy Tú (Forgein Trade University HCM Campus) Probability March 2, 2026 49 / 56
1.4. Bayes’ Theorem Bayes’ Theorem
Nguyễn Hoàng Huy Tú (Forgein Trade University HCM Campus) Probability March 2, 2026 50 / 56
1.4. Bayes’ Theorem Bayes’ Theorem
Exercise
.
b. What is the probability that a stock rated a good buy actually performed much better
than average? 4/9
Nguyễn Hoàng Huy Tú (Forgein Trade University HCM Campus) Probability March 2, 2026 51 / 56
1.4. Bayes’ Theorem Bayes’ Theorem
Exercise
b. What is the probability that a person who accepts a free dinner will purchase a car? 4/13
c. What is the probability that a person who does not accept a free dinner will purchase a
car? 2/29
Nguyễn Hoàng Huy Tú (Forgein Trade University HCM Campus) Probability March 2, 2026 52 / 56
1.4. Bayes’ Theorem Bayes’ Theorem
Exercise
Nguyễn Hoàng Huy Tú (Forgein Trade University HCM Campus) Probability March 2, 2026 53 / 56
1.4. Bayes’ Theorem Bayes’ Theorem
Exercise
Ex 4: The Watts New Lightbulb Corporation ships large consignments of bulbs. When
production is functioning correctly (90% of the time), 10% of bulbs are defective. When
malfunctioning (10% of the time), 50% are defective.
a. If a defective bulb is found, what is the probability that production is functioning
correctly? 9/14
b. If a non-defective bulb is found, what is the probability that production is functioning
correctly? 81/86
Nguyễn Hoàng Huy Tú (Forgein Trade University HCM Campus) Probability March 2, 2026 54 / 56
1.4. Bayes’ Theorem Bayes’ Theorem
Exercise
Nguyễn Hoàng Huy Tú (Forgein Trade University HCM Campus) Probability March 2, 2026 55 / 56