PAPER – II : DISTRIBUTION THEORY

� UNIT – I : Random Variables and Distribution Functions

Q1. Define a random variable. Explain its types with suitable examples.
Answer:
A random variable is a real-valued function defined on the sample space of a random
experiment, which assigns a numerical value to each outcome.
Mathematically,
�: � → ℝ

Random variables are required to be measurable functions, which makes probability and
expectation well-defined.
Types of Random Variables
(a) Discrete Random Variable
A random variable that takes countable values.
Example:
Number of heads obtained when a coin is tossed three times
� = 0,1,2,3

(b) Continuous Random Variable

A random variable that takes values over a continuous interval.
Example:
Height or weight of a person.
Conclusion
Random variables convert real-world random phenomena into mathematical form suitable for
analysis.

Q2. Define probability mass function (PMF) and state its properties.
Answer:
For a discrete random variable �, the probability mass function (PMF) is defined as:
�(�� ) = �(� = �� )

Properties of PMF
 1. �(�� ) ≥ 0for all ��
2. ∑�(�� ) = 1
3. �(� ∈ �) = ∑��∈� �( �� )

Example
For a fair coin toss:
1 1
�(� = 0) = , �(� = 1) =
2 2

Conclusion
PMF completely describes the distribution of a discrete random variable.

Q3. Define probability density function (PDF) and explain its properties.
Answer:
For a continuous random variable �, the probability density function (PDF) is a function
�(�)such that:
�
�(� < � < �) = �(�) ��
�

Properties
1. �(�) ≥ 0
∞
2. −∞
�(�) �� =1

3. �(� = �) = 0
Conclusion
PDF describes probability distribution over a continuous range.

Q4. Define distribution function (CDF) and state its properties.

Answer:
The distribution function of a random variable �is defined as:
�� (�) = �(� ≤ �)

Properties
1. 0 ≤ �(�) ≤ 1
 2. Non-decreasing
3. Right-continuous

4. lim �→−∞ �(�) = 0

5. lim �→∞ �(�) = 1

Conclusion
CDF uniquely determines the probability distribution.

Q5. Explain the relationship between PMF, PDF, and CDF.

Answer:
 For discrete random variables:

�(�) = �( ��)
��≤�

 For continuous random variables:

�
�(�) = �(�) ��
−∞

Interpretation
PMF/PDF describes local behavior, while CDF describes cumulative behavior.
Conclusion
CDF acts as a unifying function for both discrete and continuous cases.
Q6. Define expectation of a random variable and explain its properties.
Answer
The expectation (or mathematical expectation) of a random variable is a numerical measure
that represents the long-run average value of the random variable over repeated experiments.
Definition
Discrete random variable
If �is a discrete random variable with PMF �(�� ), then
�(�) = ∑�� �(��)

Continuous random variable

If �is a continuous random variable with PDF �(�), then
 ∞
�(�) = ��(�) ��
−∞

Properties of Expectation
1. Linearity:
�(�� + �) = ��(�) + �

2. Additivity:
�(� + �) = �(�) + �(�)

3. Expectation of a constant:
�(�) = �

Conclusion
Expectation is a fundamental concept used in defining variance, moments, and many
statistical measures.

Q7. Define expectation of a function of a random variable and explain its use.
Answer
Let �be a random variable and � = �(�)be a function of �.
Expectation of a Function
Discrete case
�[�(�)] = ∑�(�� )�(��)

Continuous case
∞
�[�(�)] = �(�)�(�) ��
−∞

Importance
1. Used to calculate higher moments
2. Helps in finding variance and skewness
 3. Widely applied in transformation of random variables

Conclusion
Expectation of a function generalizes the concept of expectation and is crucial in advanced
probability.

Q8. Define variance and standard deviation of a random variable. Derive an alternative
formula for variance.
Answer
Variance
The variance of a random variable �is defined as:
���(�) = �[(� − �)2 ]

where � = �(�).
Standard Deviation

��(�) = ���(�)

Derivation of Alternative Formula

���(�) = �[(� − �)2 ]
= �(�2 − 2�� + �2 )
= �(�2 ) − 2��(�) + �2
= �(�2 ) − �2

Hence,
���(�) = �(�2 ) − [�(�)]2

Conclusion
Variance measures dispersion around the mean and is fundamental in statistical analysis.

Q9. Define moments of a random variable and explain their significance.

Answer
Moments are numerical quantities that describe the shape and characteristics of a probability
distribution.

Types of Moments
1. Raw moments (about origin):
�'� = �(�� )

2. Central moments (about mean):

�� = �[(� − �)� ]

Significance
 First moment → Mean
 Second central moment → Variance
 Third central moment → Skewness
 Fourth central moment → Kurtosis

Conclusion
Moments provide a complete description of the distribution’s shape.

Q10. Explain the relationship between expectation, variance, and moments.

Answer
Expectation and variance are special cases of moments.
 Mean:
�(�) = �'1

 Variance:
���(�) = �2

Higher-order moments describe skewness and kurtosis.

Interpretation
  Expectation measures central tendency
 Variance measures dispersion
 Moments collectively describe the distribution

Conclusion
Moments unify expectation, variance, and higher-order distribution characteristics.
Q11. Explain the distribution function of a discrete random variable with an example.
Answer
For a discrete random variable �, the distribution function (CDF) is defined as
�� (�) = �(� ≤ �)

Since �takes discrete values �1 , �2 , …, the distribution function can be written as:

�� (�) = �(� = �� )
��≤�

Example
Let a random variable �take values 0,1,2with probabilities:
�(� = 0) = 0.2, �(� = 1) = 0.5, �(� = 2) = 0.3

Then,
 �� (�) = 0for � < 0
 �� (�) = 0.2for 0 ≤ � < 1
 �� (�) = 0.7for 1 ≤ � < 2
 �� (�) = 1for � ≥ 2

Conclusion
For discrete random variables, the CDF is a step function that completely characterizes the
distribution.

Q12. Explain the distribution function of a continuous random variable.

Answer
For a continuous random variable �, the distribution function is defined as:
�
�� (�) = �(� ≤ �) = �(�) ��
−∞

where �(�)is the probability density function (PDF).

Properties
1. �� (�)is continuous

2. �'� (�) = �(�)where derivative exists

3. �(� < � < �) = �� (�) − �� (�)

Conclusion
For continuous random variables, the CDF is a smooth increasing function derived from the
PDF.

Q13. Show that the distribution function uniquely determines the probability
distribution.
Answer
The distribution function �� (�)contains complete information about the probability behavior
of a random variable.
 For discrete random variables, probabilities can be obtained as:
�(� = �� ) = �� (�� ) − �� (�−
� )

 For continuous random variables, the PDF is obtained by differentiation:

�
�(�) = � (�)
�� �

Conclusion
Thus, the CDF uniquely determines the probability distribution in both discrete and
continuous cases.

Q14. Explain the concept of expectation using the law of large numbers.
Answer
Expectation represents the long-run average value of a random variable.
According to the Law of Large Numbers, if �1 , �2 , …, �� are independent and identically
distributed random variables with mean �, then
�� → �

Interpretation
 Repeated experiments stabilize around the expected value
 Expectation is not a single outcome but an average tendency

Conclusion
Expectation provides a theoretical measure of the average behavior of a random variable.

Q15. Explain the role of moments in describing a probability distribution.

Answer
Moments are numerical measures that describe various characteristics of a probability
distribution.

Role of Moments
 First moment (Mean): Location of the distribution
 Second central moment (Variance): Spread
 Third central moment: Skewness
 Fourth central moment: Kurtosis

Importance
Moments help in:
1. Comparing distributions
2. Approximating distributions
3. Statistical inference

Conclusion
Moments provide a powerful and compact way to describe the shape and behavior of
distributions.
Q16. Explain the difference between discrete and continuous random variables.
Answer
A random variable may be classified as discrete or continuous depending on the nature of
values it assumes.
Discrete Random Variable
A discrete random variable takes countable values.
 Probabilities are assigned using a PMF.
 �(� = �) > 0is possible.
Example: Number of defective items in a batch.
Continuous Random Variable
A continuous random variable takes values from a continuous interval.
 Probabilities are described using a PDF.
 �(� = �) = 0for all �.
Example: Time taken to complete a task.
Conclusion
The key distinction lies in how probabilities are assigned and calculated.

Q17. Explain why probability at a point is zero for a continuous random variable.
Answer
For a continuous random variable �,
�
�(� = �) = �(�) �� = 0
�

This is because probability is measured over intervals, not single points.

Interpretation
 The area under the curve at a single point is zero
 Probabilities are meaningful only over ranges
Conclusion
Although a continuous random variable takes specific values, the probability at any exact
point is zero.
Q18. Explain the relationship between PDF and CDF.
Answer
For a continuous random variable,
�
�� (�) = �(�) ��
−∞

Differentiating,
�
�(�) = � (�)
�� �

Interpretation
 CDF represents cumulative probability
 PDF represents rate of change of probability
Conclusion
PDF and CDF are mathematically linked and jointly describe the distribution.

Q19. Explain the importance of expectation and variance in probability theory.

Answer
Expectation and variance are fundamental numerical characteristics of a random variable.
Expectation
 Measures central tendency
 Represents long-run average
Variance
 Measures dispersion around the mean
 Indicates variability and risk
Applications
 Risk analysis
 Statistical estimation
 Quality control
Conclusion
Together, expectation and variance summarize the behavior of a random variable.
Q20. Explain how a probability distribution is completely specified.
Answer
A probability distribution is completely specified when:
 PMF is known (discrete case), or
 PDF is known (continuous case), or
 CDF is known (both cases)
Since the CDF uniquely determines the distribution, knowing it is sufficient.
Conclusion
Any one of PMF, PDF, or CDF fully characterizes a probability distribution.

UNIT – II : STANDARD DISCRETE DISTRIBUTIONS

Q1. Define Bernoulli distribution. Obtain its mean and variance.
Answer
A random variable �is said to follow a Bernoulli distribution if it takes only two values,
usually 1 (success) and 0 (failure).
Probability Mass Function
�(� = �) = �� �1−� , � = 0,1

where 0 < � < 1and � = 1 − �.

Mean
�(�) = 0 ⋅ � + 1 ⋅ � = �
Variance
�(�2 ) = 02 ⋅ � + 12 ⋅ � = �
���(�) = �(�2 ) − [�(�)]2 = � − �2 = ��

Conclusion
Bernoulli distribution models a single trial experiment with two possible outcomes.

Q2. Define Binomial distribution and derive its mean and variance.
Answer
A random variable �is said to follow a Binomial distribution if it represents the number of
successes in �independent Bernoulli trials, each with probability of success �.

Probability Mass Function

� � �−�
�(� = �) = � � , � = 0,1,2, …, �
�

Mean
�(�) = ��

Variance
���(�) = ���

Conclusion
Binomial distribution is widely used to model fixed-trial success–failure experiments.

Q3. State the assumptions of Binomial distribution and explain them.

Answer
The Binomial distribution is based on the following assumptions:
1. Fixed number of trials (�)
 2. Each trial has only two outcomes (success or failure)
3. Trials are independent
4. Probability of success �remains constant
5. Random variable counts number of successes

Conclusion
If any assumption fails, Binomial distribution is not applicable.

Q4. Define Poisson distribution and state its mean and variance.
Answer
A random variable �is said to follow a Poisson distribution if it represents the number of
occurrences of an event in a fixed interval of time or space.

Probability Mass Function

�−� ��
�(� = �) = , � = 0,1,2, …
�!

Mean and Variance

�(�) = �, ���(�) = �

Conclusion
Poisson distribution is suitable for modeling rare events.

Q5. Derive Poisson distribution as a limiting case of Binomial distribution.

Answer
Let � ∼ ���(�, �)with
� → 0, � → ∞, �� = � (finite)

Binomial PMF:
 � � �−�
�(� = �) = � �
�

As � → ∞,
� � �−� �−� ��
� � →
� �!

Conclusion
Thus, Poisson distribution is obtained as a limiting form of Binomial distribution.
Q6. Explain the properties of Binomial distribution.
Answer
The Binomial distribution possesses several important properties that make it widely
applicable.
Properties
1. Finite range:
� = 0,1,2, …, �
2. Mean:
�(�) = ��

3. Variance:
���(�) = ���

4. Mode:
(� + 1)�or(� + 1)� − 1

5. Additive property:
Sum of independent binomial variables with same �is binomial.

Conclusion
These properties make Binomial distribution suitable for many practical situations.

Q7. Explain applications of Binomial distribution.

Answer
Binomial distribution is widely used in real-life experiments.
Applications
1. Quality control (defective items)
2. Opinion polls
3. Medical trials
4. Genetics
5. Reliability testing

Conclusion
It is best suited for fixed-trial success–failure experiments.

Q8. Define Geometric distribution. Obtain its mean and variance.

Answer
A random variable �is said to follow a Geometric distribution if it represents the number of
trials required to obtain the first success.

Probability Mass Function

�(� = �) = ���−1 , � = 1,2,3, …

Mean
1
�(�) =
�

Variance
�
���(�) =
�2

Conclusion
Geometric distribution models waiting-time experiments.
Q9. Explain the memoryless property of Geometric distribution.
Answer
The Geometric distribution satisfies the memoryless property:
�(� > � + �∣� > �) = �(� > �)

Interpretation
The probability of waiting further trials does not depend on past failures.

Conclusion
Geometric distribution is the only discrete distribution with the memoryless property.

Q10. Define Negative Binomial distribution and state its applications.

Answer
The Negative Binomial distribution models the number of trials required to obtain r
successes.

Probability Mass Function

� − 1 � �−�
�(� = �) = � � , � = �, � + 1, …
�−1

Applications
1. Quality inspection
2. Reliability analysis
3. Queueing theory

Conclusion
It generalizes the Geometric distribution.
Q11. Derive the mean and variance of the Poisson distribution.
Answer
Let �be a Poisson random variable with parameter � > 0.
Probability Mass Function
 �−� ��
�(� = �) = , � = 0,1,2, …
�!

Mean
∞
�−� ��
�(�) = �
�!
�=0

Rewrite ��� = � ⋅ ��−1�:

∞
�−� ��−1
�(�) = �
(� − 1)!
�=1

Let � = � − 1:
∞
�−� ��
�(�) = � =�
�!
�=0

Variance
First find �(�2 ):
�(�2 ) = �[�(� − 1)] + �(�)

Now,
∞
�−� ��
�[�(� − 1)] = �(� − 1) = �2
�!
�=2

Hence,
�(�2 ) = �2 + �
���(�) = �(�2 ) − [�(�)]2 = �

Conclusion
For Poisson distribution, mean = variance = �.
Q12. Explain the properties of the Poisson distribution.
Answer
The Poisson distribution has several important properties:
1. Infinite support:
� = 0,1,2, …
2. Single parameter:
Completely determined by �
3. Mean equals variance:
�(�) = ���(�) = �

4. Additive property:
Sum of independent Poisson variables is Poisson.
5. Skewness:
Positively skewed for small �; approaches symmetry as �increases.

Conclusion
These properties make Poisson distribution ideal for modeling rare events.

Q13. Compare Binomial and Poisson distributions.

Answer

Binomial Distribution Poisson Distribution

Finite number of trials Infinite possible events

Parameters �, � Single parameter �

Mean = �� Mean = �

Variance = ��� Variance = �

Used for fixed trials Used for rare events

Conclusion
Poisson distribution is a limiting case of the Binomial distribution.
Q14. Derive the mean and variance of the Geometric distribution.
Answer
Let �follow a Geometric distribution with parameter �.
PMF
�(� = �) = ���−1 , � = 1,2,3, …

Mean
∞

�(�) = �� ��−1
�=1

Using known summation results,

1
�(�) =
�

Variance
�
���(�) =
�2

Conclusion
Geometric distribution models the waiting time until the first success.

Q15. Explain applications of Poisson distribution with examples.

Answer
Poisson distribution is used to model random occurrences over a fixed interval.
Applications
1. Number of phone calls in a call center per hour
2. Number of accidents at a traffic junction
3. Number of misprints per page
4. Radioactive decay events
5. Arrival of customers in queues
Conclusion
Poisson distribution is most suitable for rare and independent events.
Q16. Derive the mean and variance of the Negative Binomial distribution.
Answer
Let �be a random variable denoting the number of trials required to obtain r successes,
where each trial has probability of success �and failure � = 1 − �.
Probability Mass Function
� − 1 � �−�
�(� = �) = � � , � = �, � + 1, …
�−1

Mean
�
�(�) =
�

Variance
��
���(�) =
�2

Conclusion
Negative Binomial distribution generalizes the Geometric distribution and is useful in
modeling repeated-trial experiments.

Q17. Explain the relationship between Geometric and Negative Binomial distributions.
Answer
The Geometric distribution is a special case of the Negative Binomial distribution when
� = 1.
 Geometric: Number of trials until the first success
 Negative Binomial: Number of trials until r successes
Both distributions:
 Model waiting times
  Are discrete
 Are based on Bernoulli trials

Conclusion
Negative Binomial distribution extends the Geometric distribution to multiple successes.

Q18. Compare Bernoulli, Binomial, Geometric, and Poisson distributions.

Answer

Distribution Description Parameters

Bernoulli Single trial �

Binomial Fixed number of trials �, �

Geometric Trials until first success �

Poisson Rare events in interval �

Conclusion
Each distribution is suited for a specific type of discrete random experiment.

Q19. Explain why Poisson distribution is suitable for rare events.

Answer
Poisson distribution assumes:
 Large number of trials
 Very small probability of success
 Constant average rate �
These conditions naturally occur in rare event situations.
Examples
 Industrial accidents
 Radioactive emissions
 Network packet loss

Conclusion
Poisson distribution is ideal when events occur infrequently but independently.

Q20. Explain practical applications of standard discrete distributions.

Answer
Standard discrete distributions are used in various fields:
 Bernoulli: Yes/No decisions
 Binomial: Quality control
 Poisson: Queueing systems
 Geometric: Waiting time analysis
 Negative Binomial: Reliability testing

Conclusion
Discrete distributions form the backbone of applied probability and statistics.
UNIT – III : STANDARD CONTINUOUS DISTRIBUTIONS
Q1. Define Uniform distribution. Obtain its mean and variance.
Answer
A continuous random variable �is said to follow a Uniform distribution on the interval
� � if its probability density function is constant over that interval.
Probability Density Function
1
�(�) = � − � , � < � < �
0, otherwise

Mean
� �
1 1 �2 �+�
�(�) = � �� = =
� �−� �−� 2 �
2

Variance
 � �
2
1 2
1 �3
�(� ) = � �� =
� �−� �−� 3 �
� �)2
���(�) = �(�2 ) − [�(�)]2 =
12

Conclusion
Uniform distribution assigns equal probability to all values in a given interval.

Q2. State and explain the properties of Uniform distribution.

Answer
The important properties of the Uniform distribution are:
1. Constant PDF over � �
�+�
2. Symmetry about the midpoint 2

3. Mean = Median = Mode

4. Finite support
5. Simple structure, useful as a reference distribution

Conclusion
Uniform distribution is often used when no preference is given to any outcome in a range.

Q3. Define Exponential distribution and obtain its mean and variance.
Answer
A continuous random variable �is said to follow an Exponential distribution with parameter
� > 0if its PDF is
��−�� , �>0
�(�) =
0, otherwise

Mean
∞
1
�(�) = �� �−�� �� =
0 �
Variance
1
���(�) =
�2

Conclusion
Exponential distribution models waiting time until the first occurrence of an event.

Q4. Explain the memoryless property of Exponential distribution.

Answer
The Exponential distribution satisfies the memoryless property:
�(� > � + �∣� > �) = �(� > �)

Interpretation
The probability of waiting an additional time does not depend on how much time has already
passed.

Conclusion
Exponential distribution is the only continuous distribution with the memoryless property.

Q5. Define Normal distribution and state its probability density function.
Answer
A continuous random variable �is said to follow a Normal distribution with parameters
�and �2 if its PDF is
1 � �)2
�(�) = exp ,−∞<�<∞
2��2 2�2

Parameters
 �: mean
 �2 : variance
 Conclusion
  Normal distribution is the most important continuous distribution in statistics.

Q6. Obtain the mean and variance of the Normal distribution.

Answer
Let �be a normally distributed random variable with parameters �(mean) and �2 (variance).
Probability Density Function
1 � �)2
�(�) = exp ,−∞<�<∞
2��2 2�2

Mean
∞
�(�) = ��(�) ��
−∞

By symmetry of the normal curve about � = �,

�(�) = �

Variance
���(�) = �[(� − �)2 ]

Using standard integration results,

���(�) = �2

Conclusion
For a Normal distribution, the parameters �and �2 directly represent the mean and variance.

Q7. Explain the properties of the Normal distribution.

Answer
The Normal distribution has the following important properties:
1. Symmetry: Symmetric about the mean �
2. Bell-shaped curve: Unimodal distribution
 3. Mean = Median = Mode = �
4. Total area under curve = 1
5. Defined over −∞, ∞
6. Points of inflection: At � ± �

Conclusion
These properties make the Normal distribution widely applicable in statistics and natural
sciences.

Q8. Explain standard normal distribution and standardization.

Answer
A normal random variable with mean 0 and variance 1 is called a standard normal
distribution.
Standard Normal Variable
�−�
�=
�

The PDF of �is:

1 2 /2
�(�) = �−�
2�

Importance of Standardization
1. Converts any normal variable to standard form
2. Enables use of standard normal tables
3. Simplifies probability calculations

Conclusion
Standardization allows comparison across different normal distributions.

Q9. Define Gamma distribution and obtain its mean and variance.
Answer
A continuous random variable �follows a Gamma distribution with parameters � > 0and
� > 0if its PDF is
�� �−1 −��
�(�) = � � ,� > 0
Γ(�)

Mean
�
�(�) =
�

Variance
�
���(�) =
�2

Conclusion
Gamma distribution generalizes the Exponential distribution.

Q10. Explain the relationship between Exponential and Gamma distributions.

Answer
The Exponential distribution is a special case of the Gamma distribution when � = 1.
 Gamma: Models waiting time until �events
 Exponential: Models waiting time until first event
Both are:
 Continuous
 Right-skewed
 Defined for � > 0

Conclusion
Gamma distribution extends the Exponential distribution to multiple-event waiting times.
Q11. Explain the properties of the Exponential distribution and state its applications.
Answer
The Exponential distribution is widely used to model the waiting time until the occurrence
of an event. If a random variable �follows an Exponential distribution with parameter � > 0,
its PDF is:
�(�) = ��−�� , � > 0

Properties
1. Support: Defined only for � > 0.
2. Mean:
1
�(�) =
�

3. Variance:
1
���(�) =
�2

4. Memoryless property:
�(� > � + �∣� > �) = �(� > �)

5. Right-skewed distribution: The curve decreases exponentially.

Applications
 Waiting time in queueing systems
 Life testing and reliability analysis
 Time between arrivals in Poisson processes
Conclusion
Exponential distribution is fundamental in modeling random waiting times.

Q12. Explain the properties and applications of the Normal distribution.

Answer
The Normal distribution is the most important continuous probability distribution in
statistics.
Properties
1. Symmetric and bell-shaped curve
2. Mean = Median = Mode
3. Defined over −∞, ∞
 4. Total area under the curve equals 1
5. Determined completely by two parameters: �and �2
Applications
 Measurement errors
 Heights, weights, and biological data
 Sampling distributions (via CLT)
 Quality control
Conclusion
Normal distribution plays a central role in probability theory and statistical inference.

Q13. Define Beta distribution and obtain its mean and variance.
Answer
A continuous random variable �is said to follow a Beta distribution with parameters
� > 0and � > 0if its PDF is:
��−1 (1 − �)�−1
�(�) = ,0 < � < 1
�(�, �)

where �(�, �)is the beta function.

Mean
�
�(�) =
�+�

Variance
��
���(�) = 2
� + �) (� + � + 1

Conclusion
Beta distribution is useful for modeling random variables bounded between 0 and 1.

Q14. Explain the relationship between Gamma and Beta distributions.

Answer
Gamma and Beta distributions are closely related through special functions.
 The Beta function can be expressed in terms of Gamma functions:
 Γ(�)Γ(�)
�(�, �) =
Γ(� + �)

 Gamma distribution is defined on 0 ∞ , while Beta distribution is defined on 0 1 .

Conclusion
Both distributions are flexible and widely used in Bayesian statistics and reliability analysis.

Q15. Compare Uniform, Exponential, and Normal distributions.

Answer

Distribution Support Shape Key Feature

Uniform �� Flat Equal probability

Exponential 0∞ Right-skewed Memoryless

Normal −∞, ∞ Symmetric Bell-shaped

Conclusion
Each continuous distribution is suited for modeling different real-world phenomena.
Q16. Explain the Uniform distribution and discuss its applications.
Answer
A continuous random variable �is said to follow a Uniform distribution on the interval
� � if all values in this interval are equally likely.
Probability Density Function
1
�(�) = � − � , � < � < �
0, otherwise

Characteristics
�+�
 Mean: 2

� �)2
 Variance: 12

 Flat (rectangular) distribution

Applications
1. Random number generation
2. Simulation studies
 3. Selection processes with equal likelihood
Conclusion
Uniform distribution is used when no outcome within an interval is preferred over another.

Q17. Explain why Normal distribution is called a limiting distribution.

Answer
The Normal distribution is called a limiting distribution because many distributions tend
toward it under certain conditions.
Explanation
 By the Central Limit Theorem, the sum or average of a large number of independent
random variables approaches a normal distribution, regardless of the original
distribution.
 Binomial distribution tends to Normal distribution for large �.
Conclusion
Due to its universal appearance as a limit, the Normal distribution is fundamental in statistics.

Q18. Explain the role of continuous distributions in statistical modeling.

Answer
Continuous distributions are used to model real-valued random phenomena.
Role
1. Model measurement data (height, weight, time)
2. Describe uncertainty in natural processes
3. Used in reliability and survival analysis
4. Form the basis for inferential statistics
Conclusion
Continuous distributions are essential for realistic statistical modeling of real-world data.

Q19. Distinguish between Gamma and Exponential distributions.

Answer

Feature Exponential Gamma

Support �>0 �>0

Feature Exponential Gamma

Parameters � �, �

Mean 1/� �/�

Shape Right-skewed Flexible

Relationship Special case General case

Conclusion
Exponential distribution is a special case of the Gamma distribution when � = 1.

Q20. Explain practical applications of standard continuous distributions.

Answer
Standard continuous distributions are applied in many fields:
 Uniform: Simulation and random sampling
 Exponential: Waiting times and reliability
 Normal: Measurement errors, natural data
 Gamma: Queueing systems, rainfall modeling
 Beta: Proportions and probabilities
Conclusion
Continuous distributions provide powerful tools for modeling uncertainty in real-life
situations.
UNIT – IV : JOINT DISTRIBUTIONS
Q1. Define joint probability mass function and state its properties.
Answer
Let �and �be two discrete random variables. The joint probability mass function (JPMF)
of �and �is defined as
�(�, �) = �(� = �, � = �)

Properties
1. �(�, �) ≥ 0for all �, �

2. ∑� �(�, �) = 1
�

3. �((�, �) ∈ �) = ∑(�,�)∈� �(�, �)

Conclusion
The joint PMF completely specifies the joint distribution of two discrete random variables.

Q2. Define joint probability density function and state its properties.
Answer
Let �and �be two continuous random variables. The joint probability density function
(JPDF) is a function �(�, �)such that
�
�
�(� < � < �, � < � < �) = �(�, �) �� ��
�
�

Properties
1. �(�, �) ≥ 0
∞ ∞
2. −∞
�(�, �) �� �� =1
−∞

Conclusion
The joint PDF describes how probability is distributed jointly over two continuous random
variables.

Q3. Explain marginal distributions and obtain them from a joint distribution.
Answer
The marginal distribution of one random variable is obtained by summing or integrating the
joint distribution over the other variable.
Discrete case

�� (�) = �(�, �), �� (�) = �(�, �)

� �

Continuous case
∞ ∞
�� (�) = �(�, �) ��, �� (�) = �(�, �) ��
−∞ −∞

Conclusion
Marginal distributions describe the behavior of individual random variables independent of
the other.
Q4. Define conditional distribution and explain its significance.
Answer
The conditional distribution of �given � = �describes the distribution of �when the value
of �is known.
Discrete case
�(�, �)
�(� = �∣� = �) = , � (�) > 0
�� (�) �

Continuous case
�(�, �)
��∣� (�∣�) = , � (�) > 0
�� (�) �

Significance
 Explains dependence between variables
 Used in regression and prediction
 Important in Bayesian analysis
Conclusion
Conditional distributions provide deeper insight into joint behavior of variables.

Q5. Explain the concept of independence of two random variables.

Answer
Two random variables �and �are said to be independent if their joint distribution can be
expressed as the product of their marginal distributions.
Discrete case
�(�, �) = �� (�)�� (�)

Continuous case
�(�, �) = �� (�)�� (�)

Conclusion
Independence implies that knowledge of one variable gives no information about the other.
Q6. Explain the relationship between joint, marginal, and conditional distributions.
Answer
The concepts of joint, marginal, and conditional distributions are closely related and
together describe the complete probabilistic behavior of two random variables.
 The joint distribution describes the probability behavior of two random variables
taken together.
 The marginal distributions describe the individual behavior of each random variable.
 The conditional distributions describe the behavior of one variable when the value
of the other is known.
Mathematical Relationships
For continuous random variables:
�(�, �)
��∣� (�∣�) = and�(�, �) = ��∣� (�∣�) �� (�)
�� (�)

Similarly, marginal distributions are obtained by integrating the joint distribution.

Conclusion
Knowledge of any two among joint, marginal, and conditional distributions allows us to
determine the third.

Q7. Define covariance of two random variables and explain its properties.
Answer
The covariance between two random variables �and �measures the degree and direction of
linear relationship between them.
Definition
���(�, �) = �[(� − �� )(� − �� )]

or equivalently,
���(�, �) = �(��) − �(�)�(�)

Properties
1. ���(�, �) = ���(�)
2. ���(�, �) = ���(�, �)
3. ���(�, �) = 0if �and �are independent
4. Covariance can be positive, negative, or zero
Conclusion
Covariance indicates association but does not measure strength on a fixed scale.

Q8. Define correlation coefficient and state its properties.

Answer
The correlation coefficient measures the strength and direction of linear relationship
between two random variables.
Definition
���(�, �)
�=
�� ��

Properties
1. −1 ≤ � ≤ 1
2. � = 1: perfect positive correlation
3. � =− 1: perfect negative correlation
4. � = 0: no linear correlation

Conclusion
Correlation provides a standardized measure of linear dependence.

Q9. Explain regression lines and derive regression equations.

Answer
Regression analysis studies the relationship between two variables for prediction purposes.
There are two regression lines:
1. Regression of �on �
2. Regression of �on �

Regression Equations
 Regression of �on �:
� − � = ��� (� − �)
  Regression of �on �:
� − � = ��� (� − �)

where,
���(�, �) ���(�, �)
��� = , ��� =
���(�) ���(�)

Conclusion
Regression lines are used to predict one variable based on the other.

Q10. Explain the relationship between regression coefficients and correlation coefficient.
Answer
The regression coefficients and correlation coefficient are related as:

�= ��� ���
Important Results
1. Regression coefficients have the same sign as correlation
2. If one regression coefficient is zero, the other is also zero
3. Correlation coefficient lies between the two regression coefficients

Conclusion
Correlation measures association, while regression measures dependence for prediction.
Q11. Show that if two random variables are independent, then their covariance is zero.
Answer
Let �and �be two independent random variables.
By definition of covariance,
���(�, �) = �(��) − �(�)�(�)

Since �and �are independent,

�(��) = �(�)�(�)

Substituting,
 ���(�, �) = �(�)�(�) − �(�)�(�) = 0

Conclusion
Independence of random variables implies zero covariance.
However, zero covariance does not necessarily imply independence.

Q12. Explain whether zero covariance implies independence.

Answer
Zero covariance implies:
���(�, �) = 0

This only indicates no linear relationship between �and �.

It does not guarantee independence, because variables may still have a nonlinear
relationship.
Explanation
 Independence ⇒ Zero covariance
 Zero covariance ⇏ Independence
Conclusion
Zero covariance is a weaker condition than independence.

Q13. Explain conditional expectation and state its importance.

Answer
The conditional expectation of a random variable �given another random variable � = �is
the expected value of �when �is known.
Discrete case

�(�∣� = �) = � �(� = �∣� = �)

�

Continuous case
�(�∣� = �) = ���∣� (�∣�) ��

Importance
1. Used in regression analysis
 2. Basis of prediction models
3. Widely applied in Bayesian statistics
Conclusion
Conditional expectation provides the best mean-square prediction of a random variable.

Q14. Explain the concept of joint expectation and obtain �(��).

Answer
The joint expectation of two random variables �and �is the expected value of their product.
Discrete case

�(��) = �� �(�, �)
�
�

Continuous case
∞
∞
�(��) = �� �(�, �) �� ��
−∞
−∞

Conclusion
Joint expectation plays a key role in defining covariance and correlation.

Q15. Explain applications of joint distributions in statistics.

Answer
Joint distributions are widely used in statistical modeling.
Applications
1. Studying dependence between variables
2. Regression and prediction analysis
3. Risk management and finance
4. Quality control and reliability analysis
5. Multivariate statistical analysis
Conclusion
Joint distributions provide a comprehensive framework for analyzing relationships among
random variables.
Q16. Derive the marginal distributions from a given joint distribution with explanation.
Answer
Let �and �be two random variables with joint distribution.
Discrete case
If the joint PMF is �(�, �), the marginal distributions are obtained by summation:

�� (�) = �(�, �)
�

�� (�) = �(�, �)
�

Continuous case
If the joint PDF is �(�, �), the marginal distributions are obtained by integration:
∞
�� (�) = �(�, �) ��
−∞
∞
�� (�) = �(�, �) ��
−∞
Explanation
Marginal distributions describe the behavior of each variable separately by “eliminating” the
effect of the other variable.
Conclusion
Marginal distributions are essential for understanding individual random variables from a
joint model.
Q17. Explain conditional variance and state the law of total variance.
Answer
Conditional Variance
The conditional variance of �given � = �is defined as:
���(�∣� = �) = �[(� − �(�∣� = �))2 ∣� = �]

Law of Total Variance

���(�) = �[���(�∣�)] + ���[�(�∣�)]

Explanation
 �[���(�∣�)]: Average of conditional variability
  ���[�(�∣�)]: Variability due to conditioning on �
Conclusion
The law of total variance decomposes total variability into conditional and explained
components.

Q18. Explain the concept of correlation through joint distributions.

Answer
Correlation measures the degree of linear association between two random variables and is
derived from their joint distribution.
Definition
���(�, �)
�=
�� ��

where
���(�, �) = �(��) − �(�)�(�)
Interpretation
 � > 0: Positive association
 � < 0: Negative association
 � = 0: No linear association
 Conclusion
Correlation quantifies linear dependence using joint probabilistic behavior.

Q19. Explain bivariate normal distribution and state its properties.

Answer
Two random variables �and �are said to follow a bivariate normal distribution if their joint
PDF is:
1 1
�(�, �) = exp �
2��� �� 1 − �2 2(1 − �2 )

where
� − �� 2 � − �� � − �� � − �� 2
�= − 2� +
�� �� �� ��
Properties
1. Marginal distributions are normal
2. Conditional distributions are normal
3. Zero correlation implies independence
Conclusion
Bivariate normal distribution is fundamental in multivariate statistics.

Q20. Explain the importance of joint distributions in statistical inference.

Answer
Joint distributions play a crucial role in statistical inference.
Importance
1. Model dependence between variables
2. Basis for regression analysis
3. Used in prediction and forecasting
4. Essential in multivariate analysis
5. Foundation for Bayesian inference
Conclusion
Joint distributions provide a comprehensive framework for analyzing multiple random
variables simultaneously.