Lecture notes Chapter 6: Random Variables & Prob.

distributions

CHAPTER 6
RANDOM VARIABLES AND PROBABILITY DISTRIBUTIONS
Definition: A random variable is a numerical description of the outcomes of the experiment or
a numerical valued function defined on sample space, usually denoted by capital letters.
Example: If X is a random variable, then it is a function from the elements of the sample space
to the set of real numbers. i.e. X is a function X: S
 A random variable takes a possible outcome and assigns a number to it.
Example: Flip a coin three times, let X be the number of heads in three tosses.
 S  HHH , HHT , HTH , HTT , THH , THT , TTH , TTT 
 X HHH   3,
X HHT   X HTH   X THH   2,
X HTT   X THT   X TTH   1
X TTT   0
X = {0, 1, 2, 3}
X assumes a specific number of values with some probabilities.
Random variables are of two types:
1. Discrete random variable: are variables which can assume only a specific number of
values. They have values that can be counted
Examples:
 Toss coin n times and count the number of heads.
 Number of children in a family.
 Number of car accidents per week.
 Number of defective items in a given company.
 Number of bacteria per two cubic centimeter of water.
2. Continuous random variable: are variables that can assume all values between any two
give values.
Examples:
 Height of students at certain college.
 Mark of a student.
 Life time of light bulbs.
 Length of time required to complete a given training.

Page 1 of 15
Lecture notes Chapter 6: Random Variables & Prob. distributions

Probability Distribution
Definition: a probability distribution consists of value that a random variable can assume and
the corresponding probabilities of the values.
Example: Consider the experiment of tossing a coin three times. Let X is the number of
heads. Construct the probability distribution of X.
Solution:
 First identify the possible value that X can assume.
 Calculate the probability of each possible distinct value of X and express X in the
form of frequency distribution.

X x 0 1 2 3

P X  x  18 38 38 18

 Probability distribution is denoted by P for discrete and by f for continuous random

variable.
Properties of Probability Distribution:
1.
P ( x)  0, if X is discrete.
f ( x)  0, if X is continuous .
2.

 P X  x   1 , if X is discrete.
x

 f ( x)dx  1 , if is continuous .
x
Note:
1. If X is a continuous random variable then
b
P (a  X  b)   f ( x)dx
a

2. Probability of a fixed value of a continuous random variable is zero.

 P(a  X  b)  P(a  X  b)  P(a  X  b)  P(a  X  b)

3. If X is discrete random variable then

Page 2 of 15
Lecture notes Chapter 6: Random Variables & Prob. distributions

b 1
P ( a  X  b)   P ( x )
x  a 1
b 1
P ( a  X  b)   p ( x )
xa
b
P ( a  X  b)   P ( x )
x  a 1
b
P ( a  X  b)   P ( x )
xa
4. Probability means area for continuous random variable.

Introduction to expectation
Definition:
1. Let a discrete random variable X assume the values X1, X2, ….,Xn with the
probabilities P(X1), P(X2), ….,P(Xn) respectively. Then the expected value of X,
denoted as E(X) is defined as:
E ( X )  X 1 P ( X 1 )  X 2 P( X 2 )  ....  X n P ( X n )
n
  X i P( X i )
i 1
2. Let X be a continuous random variable assuming the values in the interval (a, b) such
b b
that  f ( x)dx  1 ,then E ( X )   x f ( x)dx
a a

Examples:
1. What is the expected value of a random variable X obtained by tossing a coin
three times where X is the number of heads?
Solution:
First construct the probability distribution of X

X x 0 1 2 3

P X  x  1 8 38 38 18

 E ( X )  X 1 P( X 1 )  X 2 P( X 2 )  ....  X n P( X n )
2. Suppose a charity
 0 *1 8  1 * 3 8  .....  2 *1 8 organization is

 1.5
Page 3 of 15
Lecture notes Chapter 6: Random Variables & Prob. distributions

mailing printed return-address stickers to over one million homes in Ethiopia.

Each recipient is asked to donate either $1, $2, $5, $10, $15, or $20. Based on
past experience, the amount a person donates is believed to follow the following
probability distribution:

X x $1 $2 $5 $10 $15 $20

P X  x  0.1 0.2 0.3 0.2 0.15 0.05

What is expected that an average donor to contribute?

Solution:

X x $1 $2 $5 $10 $15 $20 Total

P X  x  0.1 0.2 0.3 0.2 0.15 0.05 1

xP( X  x) 0.1 0.4 1.5 2 2.25 1 7.25

6
 E ( X )   xi P( X  xi )  $7.25
i 1
Mean and Variance of a random variable
Let X is given random variable.
1. The expected value of X is its mean
 Mean of X  E (X )
2. The variance of X is given by:

Variance of X  var( X )  E ( X 2 )  [ E ( X )]2

Where:
n
E ( X )   xi P( X  xi ) , if X is discrete
2 2

i 1

  x 2 f ( x)dx , if X is continuous .
x

Page 4 of 15
Lecture notes Chapter 6: Random Variables & Prob. distributions

Examples:
1. Find the mean and the variance of a random variable X in example 2 above.
Solution:

X x $1 $2 $5 $10 $15 $20 Total

P X  x  0.1 0.2 0.3 0.2 0.15 0.05 1

xP( X  x) 0.1 0.4 1.5 2 2.25 1 7.25

x 2 P( X  x) 0.1 0.8 7.5 20 33.75 20 82.15

 E ( X )  7.25
Var ( X )  E ( X 2 )  [ E ( X )]2  82.15  7.252  29.59
Exercise: Two dice are rolled. Let X is a random variable denoting the sum of the numbers
on the two dice.
i) Give the probability distribution of X
ii) Compute the expected value of X and its variance
 There are some general rules for mathematical expectation.
Let X and Y are random variables and k is a constant.
RULE 1: E (k )  k
RULE 2: Var (k )  0

RULE 3: E (kX )  kE( X )

RULE 4: Var (kX )  k
2
Var ( X )
RULE 5: E ( X  Y )  E ( X )  E (Y )
Common Discrete Probability Distributions
1. Binomial Distribution
A binomial experiment is a probability experiment that satisfies the following four
requirements called assumptions of a binomial distribution.
1. The experiment consists of n identical trials.
2. Each trial has only one of the two possible mutually exclusive outcomes, success or
a failure.
3. The probability of each outcome does not change from trial to trial, and
4. The trials are independent, thus we must sample with replacement.

Page 5 of 15
Lecture notes Chapter 6: Random Variables & Prob. distributions

Examples of binomial experiments

 Tossing a coin 20 times to see how many tails occur.
 Asking 200 people if they watch BBC news.
 Registering a newly produced product as defective or non defective.
 Asking 100 people if they favor the ruling party.
 Rolling a die to see if a 5 appears.
Definition: The outcomes of the binomial experiment and the corresponding probabilities of these
outcomes are called Binomial Distribution.
Let P  the probabilit y of success
q  1  p  the probabilit y of failure on any given trial
Then the probability of getting x successes in n trials becomes:

n
P( X  x)    p x q n  x , x  0,1,2,...., n
 x
And this is some times written as: X ~ Bin (n, p)
When using the binomial formula to solve problems, we have to identify three things:
 The number of trials ( n )
 The probability of a success on any one trial ( p ) and
 The number of successes desired ( X ).
Examples:
1. What is the probability of getting three heads by tossing a fair con four times?
Solution: Let X be the number of heads in tossing a fair coin four times
X ~ Bin (n  4, p  0.50)

Page 6 of 15
Lecture notes Chapter 6: Random Variables & Prob. distributions

n
 P( X  x)    p x q n  x , x  0,1,2,3,4
 x
 4
  0.5 x 0.54  x
 x
 4
  0.54
 x
 4
 P( X  3)   0.54  0.25
 3
2. Suppose that an examination consists of six true and false questions, and assume that a student
has no knowledge of the subject matter. The probability that the student will guess the correct
answer to the first question is 30%. Likewise, the probability of guessing each of the remaining
questions correctly is also 30%.
a) What is the probability of getting more than three correct answers?
b) What is the probability of getting at least two correct answers?
c) What is the probability of getting at most three correct answers?
d) What is the probability of getting less than five correct answers?
Solution: Let X = the number of correct answers that the student gets.
X ~ Bin (n  6, p  0.30)
a) P( X  3)  ?
n
 P( X  x)    p x q n  x , x  0,1,2,..6
 x
6
  0.3 x 0.7 6  x
 x

 P( X  3)  P( X  4)  P( X  5)  P( X  6)
 0.060  0.010  0.001
 0.071
Thus, we may conclude that if 30% of the exam questions are answered by guessing, the
probability is 0.071 (or 7.1%) that more than four of the questions are answered correctly
by the student.

Page 7 of 15
Lecture notes Chapter 6: Random Variables & Prob. distributions

b) P( X  2)  ?
P( X  2)  P( X  2)  P( X  3)  P( X  4)  P( X  5)  P( X  6)
 0.324  0.185  0.060  0.010  0.001
 0.58
c) P( X  3)  ?

P( X  3)  P( X  0)  P( X  1)  P( X  2)  P( X  3)
 0.118  0.303  0.324  0.185
 0.93
d) P( X  5)  ?
P ( X  5)  1  P ( X  5)
 1  {P ( X  5)  P ( X  6)}
 1  (0.010  0.001)
 0.989
Exercises:
a. Suppose that 4% of all TVs made by A&B Company in 2000 are defective. If eight of
these TVs are randomly selected from across the country and tested, what is the
probability that exactly three of them are defective? Assume that each TV is made
independently of the others.
b. An allergist claims that 45% of the patients she tests are allergic to some type of weed.
What is the probability that
I. Exactly 3 of her next 4 patients are allergic to weeds?
II. None of her next 4 patients are allergic to weeds?
c. Explain why the following experiments are not Binomial
I. Rolling a die until a 6 appears.
II. Asking 20 people how old they are.
III. Drawing 5 cards from a deck for a poker hand.
Remark: If X is a binomial random variable with parameters n and p then

E ( X )  np , Var ( X )  npq

2. Poisson Distribution

Page 8 of 15
Lecture notes Chapter 6: Random Variables & Prob. distributions

A random variable X is said to have a Poisson distribution if its probability distribution is

given by:

x e  
P( X  x)  , x  0,1,2,......
x!
Where   the average number .
The Poisson distribution depends only on the average number of occurrences per unit
time of space.
The Poisson distribution is used as a distribution of rare events, such as: Arrivals,
Accidents, Number of misprints, Hereditary, Natural disasters like earth quake, etc.
The process that gives rise to such events is called Poisson process.
Example: If 1.6 accidents can be expected an intersection on any given day, what is the
probability that there will be 3 accidents on any given day?
Solution: Let X =the number of accidents,   1 .6
1.6 x e 1.6
X  poisson1.6  p X  x  
x!
1.63 e 1.6
p X  3   0.1380
3!
Exercise: On the average, five smokers pass a certain street corners every ten minutes,
what is the probability that during a given 10 minutes the number of smokers passing will
be
a. 6 or fewer
b. 7 or more
c. Exactly 8…….
If X is a Poisson random variable with parameter  then

E (X )   , Var (X )  
Note: The Poisson probability distribution provides a close approximation to the binomial
probability distribution when n is large and p is quite small or quite large with   np .
(np ) x e  ( np )
P( X  x)  , x  0,1,2,......
x!
Where   np  the average number.

Page 9 of 15
Lecture notes Chapter 6: Random Variables & Prob. distributions

Usually we use this approximation if np  5 . In other words, if n  20 and np  5 [or

n(1  p)  5 ], then we may use Poisson distribution as an approximation to binomial
distribution.
Example: Find the binomial probability P(X=3) by using the Poisson distribution if p  0.01
and n  200 . Solution:
U sin g Poisson ,   np  0.01 * 200  2
23 e  2
 P ( X  3)   0.1804
3!
U sin g Binomial , n  200, p  0.01
 200 
 P ( X  3)   (0.01)3 (0.99)99  0.1814
 3 

Common Continuous Probability Distributions

1. Normal Distribution
A random variable X is said to have a normal distribution if its probability density function is
1 x  2
1   
2  
f ( x)  e ,    x  ,      ,   0
 2
Where   E ( X ),  2  Variance ( X )
 and  2 are the Parameters of the Normal Distributi on.
Properties of Normal Distribution:
1. It is bell shaped and is symmetrical about its mean and it is mesokurtic. The maximum
1
ordinate is at x   and is given by f ( x) 
 2
2. It is asymptotic to the axis, i.e., it extends indefinitely in either direction from the mean.
3. It is a continuous distribution.
4. It is a family of curves, i.e., every unique pair of mean and standard deviation defines a
different normal distribution. Thus, the normal distribution is completely described by two
parameters: mean and standard deviation.
5. Total area under the curve sums to 1, i.e., the area of the distribution on each side of the

mean is 0.5.   f ( x)dx  1


Page 10 of 15
 Lecture notes Chapter 6: Random Variables & Prob. distributions

6. It is unimodal, i.e., values mound up only in the center of the curve.

7. Mean  Median  mod e  
8. The probability that a random variable will have a value between any two points is equal to
the area under the curve between those points.
Note: To facilitate the use of normal distribution, the following distribution known as the
standard normal distribution was derived by using the transformation

X 
1
1 2z 2

Z  f ( z)  e
 2
Properties of the Standard Normal Distribution:
- Same as a normal distribution, but also mean is zero, variance is one, standard Deviation is
one
- Areas under the standard normal distribution curve have been tabulated in various ways.
The most common ones are the areas between Z  0 and a positive value of Z .
- Given normal distributed random variable X with mean  and s tan dard deviation 
a X  b
P ( a  X  b)  P (   )
  
a b
 P ( a  X  b)  P ( Z )
 
Note:
P ( a  X  b)  P ( a  X  b)
 P ( a  X  b)
 P ( a  X  b)
Examples:
1. Find the area under the standard normal distribution which lies
a) Between Z  0 and Z  0.96
Solution:
Area  P(0  Z  0.96)  0.3315

b) Between Z  1.45 and Z  0

Solution:

Page 11 of 15
Lecture notes Chapter 6: Random Variables & Prob. distributions

Area  P(1.45  Z  0)
 P(0  Z  1.45)
 0.4265
c) To the right of Z  0.35
Solution:
Area  P ( Z  0.35)
 P (0.35  Z  0)  P ( Z  0)
 P (0  Z  0.35)  P ( Z  0)
 0.1368  0.50  0.6368
d) To the left of Z  0.35
Solution:
Area  P( Z  0.35)
 1  P( Z  0.35)
 1  0.6368  0.3632

e) Between
Z  0.67 and Z  0.75
Solution:

Area  P(0.67  Z  0.75)

 P(0.67  Z  0)  P(0  Z  0.75)
 P(0  Z  0.67)  P(0  Z  0.75)
 0.2486  0.2734  0.5220
f) Between Z  0.25 and Z  1.25
Solution:
Area  P(0.25  Z  1.25)
 P(0  Z  1.25)  P(0  Z  0.25)
 0.3934  0.0987  0.2957

Page 12 of 15
Lecture notes Chapter 6: Random Variables & Prob. distributions

2. Find the value of Z if

a) The normal curve area between 0 and z(positive) is 0.4726
Solution
P(0  Z  z )  0.4726 and from table
P(0  Z  1.92)  0.4726
 z  1.92.....uniqueness of Areea.
b) The area to the left of z is 0.9868
Solution
P( Z  z )  0.9868
 P( Z  0)  P(0  Z  z )
 0.50  P(0  Z  z )
 P(0  Z  z )  0.9868  0.50  0.4868
and from table
P(0  Z  2.2)  0.4868
 z  2.2

3. A random variable X has a normal distribution with mean 80 and standard deviation
4.8. What is the probability that it will take a value
a) Less than 87.2
b) Greater than 76.4
c) Between 81.2 and 86.0
Solution
X is normal with mean,   80, s tan dard deviation,   4.8
a)

Page 13 of 15
Lecture notes Chapter 6: Random Variables & Prob. distributions

X  87.2  
P ( X  87.2)  P (  )
 
87.2  80
 P( Z  )
4.8
 P( Z  1.5)
 P( Z  0)  P(0  Z  1.5)
 0.50  0.4332  0.9332
b)

X  76.4  
P ( X  76.4)  P (  )
 
76.4  80
 P( Z  )
4 .8
 P ( Z  0.75)
 P ( Z  0)  P(0  Z  0.75)
 0.50  0.2734  0.7734
c)

81.2   X  86.0  
P (81.2  X  86.0)  P(   )
  
81.2  80 86.0  80
 P( Z )
4.8 4. 8
 P(0.25  Z  1.25)
 P (0  Z  1.25)  P (0  Z  1.25)
 0.3934  0.0987  0.2957
4. A normal distribution has mean [Link] its standard deviation if 20.0% of the area
under the normal curve lies to the right of 72.9

Solution

Page 14 of 15
Lecture notes Chapter 6: Random Variables & Prob. distributions

X  72.9  
P( X  72.9)  0.20  P(  )  0.20
 
72.9  62.4
 P( Z  )  0.20

10.5
 P( Z  )  0.20

10.5
 P (0  Z  )  0.50  0.20  0.30

And from table P(0  Z  0.84)  0.30
10.5
  0.84

   12.5

5. A random variable has a normal distribution with   5 .Find its mean if the
probability that the random variable will assume a value less than 52.5 is 0.6915.
Solution
52.5  
P( Z  z )  P( Z  )  0.6915
5
 P(0  Z  z )  0.6915  0.50  0.1915.
But from the table
 P(0  Z  0.5)  0.1915
52.5  
z  0.5
5
   50

Page 15 of 15