Central Limit Theorem in Statistics
Last Updated : 06 Nov, 2025
One of the most basic principles in statistics, the Central Limit Theorem
(CLT) describes how the sample mean distribution changes with
increasing sample size.
If the sample is sufficiently large (usually n > 30), then the sample
means' distribution will be normally distributed regardless of the
underlying population distribution, whether it is normal, skewed, or
otherwise.
All types of mean distributions tend to converge to a Normal Distribution as the sample size increases.
This is crucial since, even if population distribution is unknown,
statisticians are able to draw inferences about the population based on
the sample data. Larger samples are more accurate because CLT also
proves that the distribution of the sample
▲ mean will have the mean as the
population mean, and the standard deviation will reduce with increasing
sample size. This theorem forms the basis for many. All types of mean
distributions tend to converge to a Normal Distribution as the sample size
increases.
The Central Limit Theorem in Statistics states that as the sample size
increases and its variance is finite, then the distribution of the sample
mean approaches the normal distribution, irrespective of the shape of the
population distribution.
Central Limit Theorem Formula
Let us assume we have a random variable X. Let σ be its standard
deviation, and μ be the mean of the random variable.
Now, as per the Central Limit Theorem, the sample mean X will
approximate a normal distribution, which is given as X ⁓ N(μ, σ/√n).
x−μ
The Z-score of the random variable X is given as Z = σ
. Here xis
n
the meanX .
The image of the formula is attached below.
Central Limit Theorem Proof
Let the independent random variables be X1, X2, X3, . . . . , Xn which are
identically distributed and where their mean is zero(μ = 0) and their
variance is one(σ2 = 1).
Let's say we have a large sample of observations and each sample
is randomly produced and independent of other observations.
Calculate the average of the observations, thus having a collection
of averages of observations. Now as per the Central Limit Theorem,
if the sample size is adequately large, then the probability
distribution of these sample averages will approximate to a normal
distribution.
Assumptions of the Central Limit Theorem
The Central Limit Theorem is valid for the following conditions:
The drawing of the sample from the population should be random.
The drawing of the sample should be independent of each other.
The sample size should not exceed ten percent of the total population
when sampling is done without replacement.
Sample Size should be adequately large.
CLT only holds for a population with finite variance.
Steps to Solve Problems on Central Limit Theorem
Problems of Central Limit Theorem that involves >, < or between can be
solved by the following steps:
Step 1: First identify the >, < associated with sample size, population
size, mean and variance in the problem. Also there can be 'betwee;
associated with range of two numbers.
Step 2: Draw a Graph with Mean as Centre
Step 3: Find the Z-Score using the formula
Step 4: Refer to the Z table to find the value of Z obtained in the
previous step.
Step 5: If the problem involves '>' subtract the Z score from 0.5; if the
problem involves '<' add 0.5 to the Z score and if the problem involves
'between' then perform only step 3 and 4.
Step 6: The Z score value is found along X
Step 7: Convert the decimal value obtained in all three cases to
decimal.
Mean of the Sample Mean
According to the Central Limit Theorem:
If you have a population with a mean μ, the mean of the sample means
(also called the expected value of the sample mean) will be equal to
the population mean:
ˉ) = μ
E(X
Standard Deviation of the Sample Mean
The standard deviation of the sample mean (often called the standard
error) describes how much the sample mean is expected to vary from the
true population mean. It is calculated using the population standard
deviation σ and the sample size n:
σ
σXˉ = n
p(1−p)
σp^ =
n
(For categorical data, the standard error for
proportions is calculated using the true population proportion p)
Central Limit Theorem Applications in Computer Science
Performance Analysis & Benchmarking
Measuring latency/response times of systems (e.g., web servers,
databases).
The average latency over many requests converges to a normal
distribution.
Enables use of confidence intervals and parametric tests (t-tests) to
compare system optimizations.
A/B Testing & Experimentation