INFORMATION AND
COMMUNICATION THEORY
Unit-1: Probability Theory
Unit-2: Stochastic Processes
Unit-3: Estimation & Hypothesis Testing
Unit-4: Information Theory
Unit-5: Statistical Modeling of Noise
Module-3-Unit-2
• Stochastic Processes
• Statistical Modeling of Noise
10/6/2022 ICT (UEC-310) 1
Lecture-1 (Unit-2, Module-3)
Stochastic Process
10/6/2022 ICT (UEC-310) 2
Stochastic (Random) Process
10/6/2022 ICT (UEC-310) 3
10/6/2022 ICT (UEC-310) 4
Random Process
Example:
10/6/2022 ICT (UEC-310) 5
10/6/2022 ICT (UEC-310) 6
Continuous-time random processes
10/6/2022 ICT (UEC-310) 7
10/6/2022 ICT (UEC-310) 8
Discrete-time random processes
10/6/2022 ICT (UEC-310) 9
10/6/2022 ICT (UEC-310) 10
Example:
10/6/2022 ICT (UEC-310) 11
Solution:
10/6/2022 ICT (UEC-310) 12
Expected value of sample function at n=3
We know that
Continuous random variable
pdf
10/6/2022 ICT (UEC-310) 13
CDF of Random Process
10/6/2022 ICT (UEC-310) 14
Continued…
10/6/2022 ICT (UEC-310) 15
If the experiment is performed n times, then n functions 𝒙 𝒕, 𝜺𝒊 are
observed, one for each trial as shown in figure below:
10/6/2022 ICT (UEC-310) 16
Example:
Solution:
10/6/2022 ICT (UEC-310) 17
10/6/2022 ICT (UEC-310) 18
Mean Functions
10/6/2022 ICT (UEC-310) 19
Correlation Functions
The auto covariance function
10/6/2022 ICT (UEC-310) 20
HELP:
10/6/2022 ICT (UEC-310) 21
Continued…
10/6/2022 ICT (UEC-310) 22
Continued…
10/6/2022 ICT (UEC-310) 23
Example:
Solution:
10/6/2022 24
Continued…
10/6/2022 ICT (UEC-310) 25
10/6/2022 ICT (UEC-310) 26
Multiple Random Processes
10/6/2022 ICT (UEC-310) 27
Reference
• Athanasios Papoulis, “Probability, Random Variables, and
Stochastic Processes,” 3rd edition, McGraw Hill Publication.
• [Link]
10/6/2022 ICT (UEC-310) 28