Probability Concepts and Rules Guide
Probability Concepts and Rules Guide
Chapter 2: Probability
Chapter 2: Probability
LEARNING OBJECTIVES
1. Sample Spaces and Events
2. Interpretations of Probability
3. Addition Rules
4. Conditional Probability
5. Multiplication and Total Probability Rules
6. Independence
7. Bayes’ Theorem
Sample Spaces
Definition Random experiment
• An experiment that can result in different outcomes,
even though it is repeated in the same manner every
time, is called a random experiment.
• The set of all possible outcomes of a random
experiment is called the sample space of the
experiment. The sample space is denoted as S.
• An event is a subset of the sample space of a random
experiment.
Example
Random experiment: Roll a die
Sample space: S ={1, 2, 3, 4, 5, 6}
Event: E1 = {Die is even}={2, 4, 6}
E2 = {Die is odd}={1, 3, 5}
H1 H2 H3 H4 H5 H6 T1 T2 T3 T4 T5 T6
X 12 face cards 3
T 52 total cards 13
Addition Rules
Addition Rules
The general addition rule
2. Three events:
Example
John is going to graduate from an industrial engineering department
in a university by the end of the semester. After being interviewed at
two companies he likes, he assesses that his probability of getting an
offer from company A is 0.8, and his probability of getting an offer
from company B is 0.6. If he believes that the probability that he will
get offers from both companies is 0.5, what is the probability that he
will get at least one offer from these two companies?
P A B P A P B P A B
0.8 0.6 0.5 0.9
Example
What is the probability of getting a total of 7 or 11 when a pair of fair
dice is tossed?
Solution: Let A be the event that 7 occurs and B the event that 11
comes up.
P(A) = 6/36 and P(B) = 2/36.
The events A and B are mutually exclusive, since a total of 7 and
11 cannot both occur on the same toss. Therefore,
P A B P A P B
1 1 2
6 18 9
Example
If the probabilities are, respectively, 0.09, 0.15, 0.21, and 0.23 that a
person purchasing a new automobile will choose the color green,
white, red, or blue, what is the probability that a given buyer will
purchase a new automobile that comes in one of those colors?
P G W R B P G P W P R P B
0.09 0.15 0.21 0.23 0.68
Example
If the probabilities that an automobile mechanic will service 3, 4, 5,
6, 7, or 8 or more cars on any given workday are, respectively, 0.12,
0.19, 0.28, 0.24, 0.10, and 0.07, what is the probability that he will
service at least 5 cars on his next day at work?
Solution: Let E be the event that at least 5 cars are serviced. Now,
P(E) = 1 - P(E’), where E’ is the event that fewer than 5 cars are
serviced. Since
Let D denote the event that a part is defective and let F denote the
event that a part has a surface flaw.
Conditional Pro.
Conditional Probability
Example 2-17(page 32)
Conditional Pro.
Conditional Probability
Example
Conditional Probability
Example
Conditional Pro.
Conditional Probability
Example
Of the cars on a used car lot, 70% have air conditioning
(AC) and 40% have a CD player (CD). 20% of the cars
have both.
What is the probability that a car has a CD player, given
that it has AC?
CD No CD Total
P(CD and AC)
P(CD | AC)
AC 0.2 0.5 0.7 P(AC)
No AC 0.2 0.1 0.3 0.2
.2857
0.7
Total 0.4 0.6 1.0
Conditional Pro.
Conditional Probability
Example
The probability that a regularly scheduled flight departs on time is
P(D) = 0.83; the probability that it arrives on time is P(A) = 0.82;
and the probability that it departs and arrives on time is P(D ∩ A) =
0.78. Find the probability that a plane
(a) arrives on time, given that it departed on time,
(b) departed on time, given that it has arrived on time.
P D A 0.78
P A | D 0.94
P D 0.83
P D A 0.78
P D | A 0.95
P A 0.82
Conditional Pro.
Conditional Probability
Example
Consider an industrial process in the textile industry in which strips
of a particular type of cloth are being produced. These strips can be
defective in two ways, length and nature of texture. For the case of
the latter, the process of identification is very complicated. It is
known from historical information on the process that 10% of strips
fail the length test, 5% fail the texture test, and only 0.8% fail both
tests. If a strip is selected randomly from the process and a quick
measurement identifies it as failing the length test, what is the
probability that it is texture defective?
Conditional Pro.
Conditional Probability
Solution:
Consider the events
L: length defective, T: texture defective
Given that the strip is length defective, the probability that this strip
is texture defective is given by
P T L 0.008
P T | L 0.08
P L 0.1
Multiplication Rule
Theorem 2.10:
If in an experiment the events A and B can both occur, then
P(A ∩ B) = P(B)P(A|B) = P(A)P(B|A)
Theorem 2.12:
If, in an experiment, the events A1, A2, . . . , Ak can occur,
then
P(A1 ∩ A2 ∩ · · · ∩ Ak)
= P(A1)P(A2|A1)P(A3|A1∩A2) ··· P(Ak|A1∩A2∩···∩ Ak−1).
Multiplication Rule
Example
The probability that an automobile battery subject to high engine
compartment temperature suffers low charging current is 0.7. The
probability that a battery is subject to high engine compartment
temperature is 0.05.
The probability that a battery is subject to low charging current and high
engine compartment temperature is
Multiplication Rule
Example
The probability that the first stage of a numerically controlled
machining operation for high-rpm pistons meets specifications is
0.90. Failures are due to metal variations, fixture alignment, cutting
blade condition, vibration, and ambient environmental conditions.
Given that the first stage meets specifications, the probability that a
second stage of machining meets specifications is 0.95. What is the
probability that both stages meet specifications?
Let A and B denote the events that the first and second stages meet
specifications, respectively. The probability requested is
Example
Suppose that we have a fuse box containing 20 fuses, of which 5 are
defective. If 2 fuses are selected at random and removed from the
box in succession without replacing the first, what is the probability
that both fuses are defective?
We shall let A be the event that the first fuse is defective and B the
event that the second fuse is defective; then we interpret A ∩ B as
the event that A occurs and then B occurs after A has occurred. The
probability of first removing a defective fuse is 1/4; then the
probability of removing a second defective fuse from the remaining
4 is 4/19. Hence
1 4 1
P A B P A P B | A
4 19 19
Probability & Statistics
ĐẠI HỌC FPT CẦN THƠ
Example
One bag contains 4 white balls and 3 black balls, and a second bag
contains 3 white balls and 5 black balls. One ball is drawn from the
first bag and placed unseen in the second bag. What is the
probability that a ball now drawn from the second bag is black?
Example
Three cards are drawn in succession, without replacement, from an
ordinary deck of playing cards. Find the probability that the event
A1 ∩ A2 ∩ A3 occurs, where A1 is the event that the first card is a red
ace, A2 is the event that the second card is a 10 or a jack, and A3 is
the event that the third card is greater than 3 but less than 7.
We have
2 8 12
P A1 , P A2 | A1 , P A3 | A1 A2
52 51 50
and hence
P A1 A2 A3 P A1 P A2 | A1 P A3 | A1 A2
2 8 12 8
52 51 50 5525
Probability & Statistics
ĐẠI HỌC FPT CẦN THƠ
Figure 2-15
Partitioning an event
into two mutually
exclusive subsets.
Figure 2-16
Partitioning an
event into several
mutually
exclusive subsets.
E1 E2 … Ek =S
Let F denote the event that the product fails, and let H
denote the event that the chip is exposed to high levels of
contamination.
Probability & Statistics
ĐẠI HỌC FPT CẦN THƠ
Example
Solution
P A P B1 P A | B1 P B2 P A | B2 P B3 P A | B3
0.3 0.02 0.45 0.03 0.25 0.02 0.0245
Independence Independence
Definition
Two events is called independent if any one of the
following equivalent statements is true:
(1) P(A|B) = P(A)
(2) P(A ∩ B) = P(A)P(B)
(3) P(B|A) = P(B)
Independence Independence
Example 2-31 (page 52)
A day’s production of 850 manufactured parts contains 50 parts that do
not meet customer requirements. Two parts are selected at random,
without replacement, from the batch. Let A ={the first part is defective},
and let B ={the second part is defective}.
We suspect that these two events are not independent because knowledge
that the first part is defective suggests that it is less likely that the second
part selected is defective.
P(B|A) = 49/849
the two events
are not
independent, as
we suspected.
Independence
Definition
The events E1, E2, …, En are independent if and only if for any
subset of these events E i1 , E i2 , ... , E ik
P ( E i1 E i2 ... E ik ) P ( E i1 ) P ( E i2 ) ... P ( E ik )
Exercise
Two coins are tossed. Let A denote the event “at most one head
on the two tosses,” and let B denote the event “one head and
one tail in both tosses.” Are A and B independent events?
Independence
Example 2-24 Independence
The following circuit operates only if there is a path of functional
devices from left to right. The probability that each device functions is
shown on the graph. Assume that devices fail independently. What is the
probability that the circuit operates?
Example Independence
A small town has one fire engine and one ambulance available for
emergencies. The probability that the fire engine is available when
needed is 0.98, and the probability that the ambulance is available
when called is 0.92. In the event of an injury resulting from a
burning building, find the probability that both the ambulance and
the fire engine will be available, assuming they operate
independently.
Solution:
Let A and B represent the respective events that the fire engine and
the ambulance are available. Then
Bayes’ Theorem
Bayes’Theorem
In special case:
P( B | A) P ( A)
P( A | B) for P ( B ) 0
P( B)
Bayes’ Theorem
Example
Suppose that P(A | B) = 0.7, P(A) = 0.5, and P(B) = 0.2.
Determine P(B | A).
P B P A | B 0.2*0.7
P B | A 0.28
P A 0.5
Bayes’ Theorem
Example
In a state where cars have to be tested for the emission of pollutants, 25%
of all cars emit excessive amount of pollutants. When tested, 99% of all
cars that emit excessive amount of pollutants will fail, but 17% of all cars
that do not emit excessive amount of pollutants will also fail. What is the
probability that a car that fails the test actually emits excessive amounts
of pollutants?
Bayes’ Theorem
P(A) P ( B | A)
P(A | B)
P (B)
where
P(B) = P(A)P(B|A) + P(A’)P(B|A’)
= 0.25*0.99 + 0.75*0.17 = 0.375
Bayes’ Theorem
Example
Two events A and B are such that P[A∩B] = 0.15, P[A B]
= 0.65, and P[A|B] = 0.5. Find P[B|A].
Bayes’ Theorem
Example
A manufacturing firm employs three analytical plans for the design
and development of a particular product. For cost reasons, all three
are used at varying times. In fact, plans 1, 2, and 3 are used for 30%,
20%, and 50% of the products, respectively. The defect rate is
different for the three procedures as follows:
P(D|P1) = 0.01, P(D|P2) = 0.03, P(D|P3) = 0.02,
where P(D|Pj) is the probability of a defective product, given plan j. If
a random product was observed and found to be defective, which
plan was most likely used and thus responsible?
Bayes’ Theorem
From the statement of the problem
P(P1) = 0.30, P(P2) = 0.20, and P(P3) = 0.50,
we must find P(Pj|D) for j = 1, 2, 3. Bayes’ rule shows
P P1 P D | P1
P P1 | D
P P1 P D | P1 P P2 P D | P2 P P3 P D | P3
0.3*0.01 0.003
0.158
0.3*0.01 0.2*0.03 0.5*0.02 0.019
Similarly
0.03*0.2 0.02*0.5
P P2 | D 0.316 P P3 | D 0.526
0.019 0.019
The conditional probability of a defect given plan 3 is the largest
of the three; thus a defective for a random product is most likely
the result of the use of plan 3
Probability & Statistics
ĐẠI HỌC FPT CẦN THƠ
Bayes’ Theorem
Example
Customers are used to evaluate preliminary product designs. In the
past, 95% of highly successful products received good reviews, 60%
of moderately successful products received good reviews, and 10%
of poor products received good reviews. In addition, 40% of products
have been highly successful, 35% have been moderately successful,
and 25% have been poor products.
a. What is the probability that a product attains a good review?
b. If a new design attains a good review, what is the probability that it
will be a highly successful product?
c. If a product does not attain a good review, what is the probability
that it will be a highly successful product?
a) P B P A1 P B | A1 P A2 P B | A2 P A3 P B | A3
0.4* 0.95 0.35*0.6 0.25*0.1 0.615
P A1 P B | A1 0.4*0.95
b) P A1 | B 0.618
P B 0.615