NORMAL (GAUSSIAN)
DISTRIBUTION
A Comprehensive Study Guide for AI & Data Science Professionals
1. Introduction to the Bell Curve
The Normal Distribution is a continuous probability distribution characterized by its
symmetrical "bell" shape. It is the most significant distribution in statistics because
many real-world datasets naturally cluster around a central average.
Key Characteristics:
• Symmetry: The left and right halves are mirror images across the mean.
• Unimodal: It has a single peak (mode) where the Mean, Median, and Mode
are all equal.
• Asymptotic: The tails approach the x-axis but never touch it.
2. Mathematical Definition
The distribution is defined by two primary parameters: Mean (μ), which determines
the center, and Standard Deviation (σ), which determines the spread.
Probability Density Function (PDF)
f(x) = rac{1}{\sigma\sqrt{2\pi}} e^{- rac{1}{2}\left( rac{x-\mu}
{\sigma} ight)^2}
Standardization (Z-Score)
To compare different normal distributions, we convert data points into Z-scores. This
transforms the distribution into a Standard Normal Distribution where μ = 0 and σ
= 1.
Z = rac{x - \mu}{\sigma}
Where x is the raw score, μ is the population mean, and σ is the standard deviation.
3. The Empirical Rule (68-95-99.7)
In a perfectly normal distribution, the percentage of data falling within specific
standard deviations from the mean is always constant:
Distance from Percentage of
Interpretation
Mean Data
± 1 Standard
68.27% Majority of the data points
Deviation
± 2 Standard
95.45% Almost all data points
Deviations
± 3 Standard Total population (excluding extreme
99.73%
Deviations outliers)
4. Practical Example: Height Analysis
Scenario: Suppose adult heights follow a Normal Distribution with a mean (μ)
of 160 cm and a standard deviation (σ) of 15 cm.
Problem: Calculate the probability that a randomly selected person has a
height between 130 cm and 190 cm.
Calculation:
• Lower bound (130 cm) = 160 - (2 * 15) → This is -2σ
• Upper bound (190 cm) = 160 + (2 * 15) → This is +2σ
• According to the Empirical Rule, ± 2σ covers 95.45%.
Result: There is a 95.45% probability (or 0.9545) that the person is between
130 and 190 cm tall.
5. Why it Matters in Data Science
• The Central Limit Theorem (CLT): CLT states that as sample sizes increase, the
distribution of the sample means will follow a normal distribution, regardless of the
population's shape.
• Model Assumptions: Many popular algorithms, such as Linear Regression and
Gaussian Naive Bayes, assume that the input features or errors follow a normal
distribution.
• Hypothesis Testing: Common statistical tests (Z-tests, T-tests, ANOVA) are built
on the foundation of normality.
• Anomaly Detection: Points lying beyond ± 3σ are statistically rare and are often
treated as anomalies or outliers.
Study Material | Statistics & Probability Series | AI Engineer Reference