Basic Probability and Random Variables
Name - Dev Divyeshkumar Prajapati
Enrollment No - 240130111025
Batch - EC A2
Abstract
This report provides a foundational overview of basic probability concepts and random
variables. It introduces essential definitions, core principles, and common distributions,
serving as a resource for beginners in probability theory. The contents are structured to
span approximately five pages of academic-style text.
1. Introduction
Probability theory is a branch of mathematics concerned with quantifying uncertainty. It
allows us to model, analyze, and predict outcomes of random phenomena. Whether in data
science, engineering, economics, or everyday decision-making, probability provides the
tools to understand and manage randomness.
Random variables, which map outcomes of random processes to numerical values, form the
basis for more advanced topics such as statistical inference, machine learning models, and
stochastic processes.
This report introduces key concepts of probability and random variables, ensuring clarity
for readers with minimal mathematical background.
2. Basic Concepts in Probability
2.1 Sample Space
A sample space (S) is the set of all possible outcomes of an experiment.
Examples:
- Tossing a coin: S = {H, T}
- Rolling a six-sided die: S = {1,2,3,4,5,6}
2.2 Events
An event is a subset of the sample space.
Examples:
- Rolling an odd number: {1,3,5}
- Getting heads on a coin flip: {H}
2.3 Axioms of Probability
Probability is a function P(E) that assigns a number between 0 and 1 to each event,
satisfying:
1. Non-negativity: P(E) ≥ 0
2. Normalization: P(S) = 1
3. Additivity: If E1 and E2 are mutually exclusive, P(E1 ∪ E2) = P(E1) + P(E2)
2.4 Conditional Probability
P(A|B) = P(A ∩ B) / P(B), provided P(B) > 0.
2.5 Independence
Two events A and B are independent if:
P(A ∩ B) = P(A)P(B)
3. Random Variables
3.1 Definition
A random variable (RV) maps outcomes of an experiment to real numbers.
Types:
- Discrete RVs
- Continuous RVs
3.2 Probability Mass Function (PMF)
For a discrete RV X:
P(X = x)
Requirements:
- P(X = x) ≥ 0
- Σ P(X = x) = 1
3.3 Probability Density Function (PDF)
For a continuous RV X:
P(a ≤ X ≤ b) = ∫ f(x) dx
Requirements:
- f(x) ≥ 0
- ∫ f(x) dx = 1 over all real numbers
3.4 Cumulative Distribution Function (CDF)
F(x) = P(X ≤ x)
Properties:
- Non-decreasing
- Approaches 0 as x → −∞ and 1 as x → +∞
4. Expected Value and Variance
4.1 Expected Value
Discrete: E[X] = Σ x · P(X = x)
Continuous: E[X] = ∫ x f(x) dx
4.2 Variance
Var(X) = E[(X − E[X])²]
5. Common Probability Distributions
5.1 Bernoulli Distribution
Takes value 1 with probability p and 0 with probability (1 − p).
E[X] = p
Var(X) = p(1 − p)
5.2 Binomial Distribution
Models successes in n independent Bernoulli trials.
PMF: P(X = k) = C(n, k)p^k(1 − p)^(n − k)
E[X] = np
Var(X) = np(1 − p)
5.3 Normal Distribution
Continuous distribution with mean μ and variance σ².
PDF: (1 / √(2πσ²)) * e^(-(x − μ)² / (2σ²))
5.4 Exponential Distribution
PDF: λe^(−λx), x ≥ 0
6. Applications of Probability and Random Variables
- Machine learning
- Finance
- Engineering
- Medicine
- Computer science
7. Conclusion
This report outlines the foundational principles of probability and random variables. These
concepts serve as the basis for more advanced statistical topics, including hypothesis
testing, regression, stochastic processes, and machine learning. A solid understanding of
probability equips learners to analyze uncertain systems and make informed decisions.
References
1. Ross, S. M. Introduction to Probability Models
2. Grimmett, G., & Welsh, D. Probability: An Introduction
3. Sheldon, R. A First Course in Probability