BASIC CONCEPTS IN PROBABILITY
• Readings: Sections 1, 2
Lecture outline
• Motivation
• Sample space of an experiment
– Examples
• Axioms of probability
– More examples
Motivation
• Why do we study probability theory?
– An effective model of uncertainty
– Decision Making under uncertainty
• Examples:
– Measurement sensors
– Waiting time at a Bank’s teller.
– Value of a stock at a given day.
– Outcome of a medical procedure.
– A customer buying behavior.
• One Decision Making Process: Collect Data, Model the
Phenomenon, Extrapolate and make decisions.
From Frequency to Probability (1)
• The time of recovery (Fast, Slow, Unsuccessful) from an
ACL knee surgery was seen to be a function of the
patient’s age (Young, Old) and weight (Heavy, Light).
The medical department at MIT collected the following
data:
S,Fast S,Slow U
Y,L 1000 150 50
Y,H 500 300 100
O,L 400 400 200
O,H 200 600 300
From Frequency to Probability (2)
S, Fast S, Slow U
Y,L 1000 150 50
Y,H 500 300 100
O,L 400 400 200
O,H 200 600 300
• What is the “likelihood” that a 40 years old man (Old!) will
have a successful surgery with a speedy recovery?
• If a patient undergoes an operation, what is the
“likelihood” that the result is unsuccessful?
• Need a measure of “likelihood”.
• Ingredients: Sample space, Events, Probability.
Think of Probability as Frequency....
Sample Space
• List of possible outcomes
• List must be:
– Mutually exclusive
– Collectively exhaustive
– At the “right” granularity
Sample Space Example (1)
• Two rolls of a tetrahedral die
– Sample space vs. sequential description
Sample Space Example (2)
• A continuous sample space:
Axioms of probability
• Event: a subset of the sample space
• Probability is assigned to events
• Axioms:
• Axiom 3 needs strengthening
• Do weird sets have probabilities?
Example (1) Revisited
• Let every possible outcome
have probability
• Define
Discrete Uniform Law
• Let all sample points be equally likely
• Then,
• Just count …
Example (2) Revisited
• Each of two people choose a number between zero and
one. What is the probability that they are at most 1/4
apart?
• Draw sample space and event of interest:
1/4
1/4
• Need to choose a probability law:
– Choose uniform law: probability = area
The probability is:
A Word About Infinite
Sample Spaces
• Sample space:
– We are given
– Find
• Solution:
• Axiom needed:
If are disjoint events, then:
Probability and the “Real World”
• Probability is a branch of math:
– Axioms ⇒ Theorems
– One theorem: Frequency of event is
• But are probabilities frequencies?
–
–
–
• Probability models as a way of describing uncertainty:
– Use for consistent reasoning
– Use for predictions, decisions