Random Process Complete
Random Process Complete
5
X(t) and Y(t) are jointly strictly stationary if the joint
finite-dimensional distribution of X (t1 ) X (tk ) and
Y (t1' )Y (t j' ) are invariant w.r.t. the origin t = 0.
6
Figure 1.2 Illustrating the probability of a joint event. 7
Figure 1.3 Illustrating the concept of stationarity in Example 1.1.
8
1.4 Mean, Correlation,and Covariance Function
Let X(t) be a strictly stationary RP
The mean of X(t) is
X (t ) = EX (t )
= xf X ( t ) ( x ) d x (1.6)
−
= X for all t (1.7)
fX(t)(x) : the first order pdf.
The autocorrelation function of X(t) is
2. RX (t ) = R(−τ) (1.13)
3. RX (t ) RX (0) (1.14)
11
Proof of property 3:
Consider E[( X (t + τ ) X (t ))2 ] 0
E[ X 2 (t + t )] 2 E[ X (t + t ) X (t )] + E[ X 2 (t )] 0
2 E[ X (t )] 2 RX (t ) 0
2
13
Example 1.2 X (t ) = Acos(2πfct + Θ) (1.15)
1
, −π θ π
f ( ) = 2π
0, elsewhere (1.16)
f
θ
−π π
A2
RX (t ) = E X (t + τ ) X (t ) = cos(2πfct ) (1.17)
2
14
X (t ) = Acos(2πfct + Θ)
A2
RX (t ) = E X (t + τ ) X (t ) = cos(2πfct )
2
15
• 2cosA cosB= cos(A+B)+cos(A-B)
16
Appendix 2.1 Fourier Transform
17
We refer to |G(f)| as the magnitude spectrum of the signal g(t),
and refer to arg {G(f)} as its phase spectrum.
18
DIRAC DELTA FUNCTION
19
The Dirac delta function or just delta function, denoted by (t ) ,
is defined as having zero amplitude everywhere except
at t = 0 , where it is infinitely large in such a way that it
contains unit area under its curve; that is
(t ) = 0, t 0 (A2.3)
and
− (t )dt = 1 (A2.4)
−
g (t ) (t − t0 ) dt = g (t0 ) (A2.5)
−
g (t ) (t − t )dt = g (t ) (A2.6)
20
21
Cross-correlation Function
RXY (t,u) = E X (t )Y (u) (1.19)
and RYX (t,u) = EY (t ) X (u) (1.20)
Note RXY (t, u) and RYX (t , u) are not general even
functions.
The correlation matrix is
RX (t , u ) RXY (t , u )
R (t , u ) =
YX
R ( t , u ) RY ( t , u )
If X(t) and Y(t) are jointly stationary
RX (t ) RXY (t )
R (t ) = (1.21)
RYX (t ) RY (t )
where τ = t − u 22
Proof of RXY (t ) = RYX (−τ ) :
RXY ( τ ) = E[ X (t )Y (t − τ )]
Let t − τ = μ,
RXY ( τ ) = E[ X ( + t )Y ( )]
= E[Y ( ) X ( + t )]
= E[Y (t ) X (t − ( −t )]
= RYX ( − τ ) (1.22)
23
Example 1.4 Quadrature-Modulated Process
X 1 (t ) = X (t ) cos(2πfct + )
X 2 (t ) = X (t ) sin(2πfct + ),
where X(t) is a stationary process and is uniformly
distributed over [0, 2].
R12 (ττ) = E X 1 (t ) X 2 (t − τ )
= E X (t ) X (t − τ )E cos(2πfct + ) sin(2πfc t − 2πfc τ + )
= RX ( τ ) E sin(2πfct − 2πfc τ + 2) − E sin(2πfc τ ) (1.23)
1
2
1
= − RX ( τ ) sin(2πfc τ ) =0
2
At t = 0, sin(2πfc τ ) = 0, R12 (t ) = 0 ,
24
X 1 (t ) and X 2 (t ) are orthogonal.
1.5 Ergodic Processes
Ensemble averages of X(t) are averages “across the process”.
Long-term averages (time averages) are averages “along the
process ”
DC value of X(t) (random variable)
1 T
μx (T ) =
2T −T
x (t ) dt (1.24)
If X(t) is stationary,
? 1
E μx (T ) = E x (t ) dt
T
2T − T
1 T
=
2T −T μ X dt
25
= μX (1.25)
x (T ) represents an unbiased estimate of X
The process X(t) is ergodic in the mean, if
a. lim μx (T ) = μX
T →
b. lim var μx (T ) = 0
T →
Y (t ) = h ( τ1 ) X (t − τ1 ) dτ1
-
where h(t) is the impulse response of the system
μY (t ) = E Y (t )
= E h ( τ1 ) X (t − τ1 ) dτ1
(1.27)
-
h ( τ1 ) E x (t − τ1 ) dτ1
If E[X(t)] is finite = -
and system is stable
= -
h ( τ1 ) μ X (t − τ1 ) dτ1 (1.28
If X(t) is stationary, μY = μ X - h( τ1 ) dτ1 = μ X H (0), (1.29)
H(0) :System DC response. 27
Consider autocorrelation function of Y(t):
RY (t, ) = E Y (t )Y ( )
= E h( τ1 ) X (t − τ1 ) dτ1 h( τ 2 ) X ( μ − τ 2 ) dτ 2
(1.30)
− −
If E[ X 2 (t )] is finite and the system is stable,
RY (t,μ ) = dτ1 h ( τ1 ) dτ 2 h( τ2 ) RX (t − τ1, − τ 2 ) (1.31)
− −
If R (t − τ , μ − τ ) = R (t − μ − τ + τ ) (stationary)
X 1 2 X 1 2
τ=t- μ
RY ( τ ) = h( τ1 )h( τ2 ) RX ( τ − τ1 + τ 2 ) dτ1 dτ 2 (1.32)
− −
− −
h ( τ1 )h( τ2 )RX ( τ 2 − τ1 ) dτ1 dτ 2 (1.33)
28
1.7 Power Spectral Density (PSD)
Consider the Fourier transform of g(t),
G ( f ) = g (t ) exp( − j 2πft) dt
−
g (t ) = G ( f ) exp( j 2πft) df
−
2
E Y (t ) = H ( f ) exp( j 2fτ1 ) df h( τ2 ) RX ( τ2 − τ1 ) dτ1 dτ2
− −
−
=
−
df H ( f ) dτ2h( τ2 ) RX (τ2 − τ1 ) exp( j 2fτ1 ) dτ1
− −
(1.35)
= df H ( f ) dτ2h(τ2 ) exp( j 2fτ2 ) RX (t ) exp( − j 2fτ ) dt (1.36 )
− − −
*
H ( f ) (complex conjugateresponseof the filter) 29
2
E Y (t ) = df H ( f )
-
2
-
RX (τ ) exp( − j 2ft ) dτ (1.37)
H ( f ) : the magnitude response
Define: Power Spectral Density ( Fourier Transform ofR(τ ) )
S X ( f ) = RX (t ) exp( −2πfτ) dt (1.38)
-
2
E Y (t ) = H ( f ) S X ( f ) df
-
2
(1.39)
Recall E Y (t ) = h( τ1 )RX ( τ2 − τ1 ) dτ1 dτ2
2
(1.33)
- -
Let H ( f ) be the magnitude response of an ideal narrowband filter
1, f f 1
Df
|H ( f )| = c 2
1 (1.40)
0, f f c 2 Df
Df : Filter Bandwidth
If Δf f c and S X ( f ) is continuous,
E Y 2 (t ) 2Δf S X ( f c ) in W/Hz
30
Properties of The PSD
S X ( f ) = RX ( τ ) exp( − j 2ft ) dt (1.42)
−
RX ( τ ) = S X ( τ ) exp( j 2ft ) df (1.43)
−
Einstein-Wiener-Kintchine relations:
S X ( f ) RX ( τ )
31
a. S X (0) = RX ( τ ) dt (1.44)
−
b. E X (t ) = S X ( f ) df
2
−
(1.45)
c. If X (t ) is stationary,
E Y 2 (t ) (2Δf ) S X ( f ) 0
SX ( f ) 0 for all f (1.46)
d. S X ( − f ) = RX ( τ ) exp( j 2ft ) dτ
−
= RX (u ) exp( − j 2fu) du, u = −τ
−
= SX ( f ) (1.47)
e. The PSD can be associated with a pdf :
SX ( f )
pX ( f ) = (1.48)
S X ( f ) df − 32
Example 1.5 Sinusoidal Wave with Random Phase
X (t ) = A cos(2fct + ), ~ U ( − , − )
A2
RX (t ) = cos(2fct )
2
S X ( f ) = RX (t ) exp( − j 2ft ) dt
−
A2
= −
exp( j 2f ct )dt + exp( − j 2f ct )exp( − j 2ft ) dt
4
A2
= ( f − f c ) + ( f + f c )
4
exp j 2 ( f c − f ) dt = ( f − f c )
Appendix 2, −
33
Example 1.6 Random Binary Wave (Example 1.3)
A, if m(t) = 1
X (t ) =
− A, if m(t) = 0
2 t t T
A (1 − )
R X (t ) = T
t T
0
T t
SX ( f ) = −T
) exp( − j 2ft ) dt
A2 (1 −
T
= A 2T sinc2 ( f T ) (1.50)
Define the energy spectral density of a pulse as
εg ( f ) = A2T 2 sinc2 ( f T ) (1.51)
g ( f )
SX ( f ) = (1.52)
T
34
Example 1.7 Mixing of a Random Process with a Sinusoidal Process
X(t) Y(t)
h(t)
SX (f) SY (f)
Recall (1.32)
RY (t ) = h (t 1 )h(t 2 ) RX (t − t 1 + t 2 ) dt 1 dt 2 (1.32)
− −
SY ( f ) = h(t 1 )h(t 2 ) RX (t − t 1 + t 2 ) exp( − j 2ft ) dt 1 dt 2 dt
− − −
Let t − t 1 + t 2 = t 0 , or t = t 0 + t 1 − t 2
SY ( f ) = h(t 1 )h(t 2 ) RX (t 1 ) exp( j 2ft 0 ) exp( − j 2ft 2 ) exp( − j 2ft 0 ) dτ1 dτ 2 dτ0
− − −
= SX ( f )H ( f )H * ( f )
= H ( f ) SX ( f )
2
(1.58) 36
Relation Among The PSD and
The Magnitude Spectrum of a Sample Function
This condition can never be satisfied by any stationary x(t) with infinite duration.
T
We may write X ( f , T ) = x(t ) exp( − j 2ft ) dt (1.60)
−T
RX (t ) = lim
1
− T → 2T
2
E X ( f − T ) exp( j 2ft )df
(1.66)
Recall (1.43) RX (t ) = S X ( f ) exp( j 2ft )df
−
S X ( f ) = lim
1
T → 2T
E X ( f ,T )
2
1 T 2
= lim E x (t ) exp( − j 2ft )dt (1.67)
T → 2T
−T
38
(1.67) is used to estimate the PSD of x(t)
Cross-Spectral Densities
S XY ( f ) = RXY (t ) exp( − j 2ft )dt (1.68)
−
SYX ( f ) = RYX (t ) exp( − j 2ft )dt (1.69)
−
RVZ (t , u ) = E V (t ) Z (u )
= E h1 (t 1 ) X (t − t 1 )dt 1 h2 (t 2 )Y (u − t 2 )dt 2
− −
= h1 (t 1 )h2 (t 2 )RXY (t − t 1 , u − t 2 )dt 1dt 2
− −
Let τ = t − u
RVZ (t ) = h1 (t 1 )h2 (t 2 )RXY (t − t 1 + t 2 )dt 1dt 2 (1.77)
− −
F
→ SVY ( f ) = H1 ( f ) H 2 ( f ) SXY ( f ) 40
1.8 Gaussian Process
Define : Y as a linear functional of X(t)
T
Y = g (t ) X (t )dt ( g(t): some function) (1.79)
0
( )( )
C X (tk , ti ) = E X (tk ) − X ( tk ) X (ti ) − X ( ti ) , k,i = 1,2 ,...,n
where X = X (t1) ,X (t 2) ,....,X (tn )
T
1 1 −1
Then f X ( t1 ),...,X ( tn ) ( x1 ,..., xn ) = n 1
exp( − ( x − μ ) T
Σ (x − μ)) (1.85)
(2 ) 2 D 2 2
where μ = mean vector = 1 , 2 ,...., n
T
45
2 i 2 i2
1.9 Noise
· Shot noise
· Thermal noise
2
E VTN = 4kTRDf volts 2
E I = E V = 4kT Df = 4kTGDf
2 1 2 1
TN 2 TN amps 2
R R
k: Boltzmann’s constant = 1.38 x 10-23 joules/K, T is the
absolute temperature in degree Kelvin. 46
· White noise
N0
SW ( f ) = (1.93)
2
N 0 = kTe (1.94)
Te : equivalent noise temperature of the receiver
N0
RW (t ) = (t ) (1.95)
2
47
Example 1.10 Ideal Low-Pass Filtered White Noise
N 0 -B f B
SN ( f ) = 2 (1.96)
0 f B
B N
RN (t ) = 0
exp( j 2 ft ) df (1.97)
−B 2
= N 0 B sinc(2 Bt ) 48
Example 1.11 Correlation of White Noise with a Sinusoidal Wave
'
w (t ) w (t ) T
White noise X dt
0
2 k
cos(2fct ) , fc = , k is integer
T T
2 T
w' (t ) =
T 0
w(t ) cos(2f c t )dt (1.98)
2 = E
2 T T
T
0 0 w( t1 ) cos(2 f c t1 ) w( t 2 ) cos(2 f c t 2 ) dt1 dt2
2 T T
=
T 0 0
RW (t1 , t2 ) cos(2 f c t1 ) cos(2 f c t2 ) dt1 dt2
From (1.95)
2 T T N0
2 = (t1 − t2 ) cos(2 f c t1 ) cos(2 f c t2 ) dt1 dt2
T 0 0 2
N0 T N0
T 0
49
= cos 2
( 2 f c t ) dt = (1.99)
2
1.10 Narrowband Noise (NBN)
Two representations
a. in-phase and quadrature components (cos(2fct) ,sin(2fct))
[Link] and phase
1.11 In-phase and quadrature representation
n(t ) = nI (t ) cos(2 f ct ) − nQ (t ) sin(2 f ct ) (1.100)
nI (t ) and nQ (t ) are low - pass signals
50
Important Properties
[Link](t) and nQ(t) have zero mean.
[Link] n(t) is Gaussian then nI(t) and nQ(t) are jointly Gaussian.
[Link] n(t) is stationary then nI(t) and nQ(t) are jointly stationary.
S N ( f − f c ) + S N ( f + f c ) , -B f B
[Link] I ( f ) = SNQ ( f ) = (1.101)
0 otherwise
N0
5. nI(t) and nQ(t) have the same variance 2
.
[Link]-spectral density is purely imaginary.
S N I NQ ( f ) = − S NQ N I ( f )
jS N ( f + f c ) − S N ( f − f c ) , -B f B
= (1.102)
0 otherwise
[Link] n(t) is Gaussian, its PSD is symmetric about fc, then nI(t) and nQ(t)
are statistically independent.
51
Example 1.12 Ideal Band-Pass Filtered White Noise
− fc + B
N0 fc + B N
RN (t ) = exp( j 2 ft )df + 0
exp( j 2 ft )df
− fc −B 2 fc −B 2
Let NI and NQ be R.V.s obtained (at some fixed time) from nI(t)
and nQ(t). NI and NQ are independent Gaussian with zero mean and
variance 2. 53
1 nI2 + nQ2
f N I , NQ (nI , nQ ) = exp(− ) (1.108)
2 2
2 2
1 nI2 + nQ2
f N I , NQ (nI , nQ )dnI dnQ = exp( − ) dnI dnQ (1.109)
2 2
2 2
r r2
f R ( r ) = 2 exp( − 2 2 ) , r 0 (1.115)
0 elsewhere
f R ( r ) is Rayleigh distribution.
r
For convenience , let ν = . fV ( ν ) = f R ( r )
σ
2
fV ( ν ) = exp( − 2 ) , 0 (1.118)
0 elsewhere 55
Figure 1.22 Normalized Rayleigh distribution.
56
1.13 Sine Wave Plus Narrowband Noise
x(t ) = A cos(2f ct ) + n(t ) (1.119)
x(t ) = nI (t ) cos(2f ct ) − nQ (t ) sin(2f ct )
nI (t ) = A + nI (t )
If n(t) is Gaussian with zero mean and variance 2
1. nI ' ( t ) and nQ (t ) are Gaussian and statistically independent.
[Link] mean of nI ' ( t ) is A and that of nQ (t ) is zero.
[Link] variance of nI ' ( t ) and nQ (t ) is 2 .
(nI − A) 2 + nQ
2
1
f N I , NQ (nI , nQ ) = exp −
2 2
2 2
1
r (t ) = nI (t ) + nQ2 (t )
2 2
Let (1.123)
nQ (t )
(t) = tan -1 (1.124)
nI (t )
Follow a similar procedure , we have
r r 2 + A2 − 2 Ar cos
f R ,Ψ ( r, ) = exp( − )
2 2
2 2
57
R and are dependent.
2
f R (r) = f R ,Ψ ( r, )d
0
r r 2 + A2 2 Ar
= exp( − ) exp( 2 cos )d (1.126)
2 2
2 2 0
Ar r r 2 + A2 Ar
Let x = 2 , f R(r) = 2 exp( − ) I0 ( 2 ) (1.128)
σ 2 2
It is called Rician distribution.
58
r A
Normalized = ,a =
fV (v ) = f R ( r ) (1.131)
v2 + a2
= v exp( − ) I 0 (av) (1.132)
2