KOM505E Probability Theory and Stochastic Processes
Fall 2016-2017
Istanbul Technical University, Computer Engineering Department
Instructors :
G
ozde Unal
(CRN 14105)
EEB 5309
[Link]@[Link]
Mustafa E. Kamasak (CRN 14106)
EEB 3307
kamasak@[Link]
Class Meets :
13.30 16.30, Tuesday
EEB 5207 (Dr. Unal)
EEB 5306 (Dr. Kamasak)
Office Hours :
Dr. Unal
TBA
Dr. Kamasak
TBA
Textbooks :
Intuitive Probability and Random Processes using MATLAB,
Kay, Steven, Springer, 2012.
(available in the University Library. This is the main textbook.)
Probability ans Statistical Inference,
Nitis Mukhopadhyay, Marcel Dekker, Inc., 2000.
(available in the University Library)
Probability, Random Variables and Stochastic Processes,
Athanasios Papoulis, Mcgraw-Hill College.
(available in the University Library)
A First Course in Probability, Sheldon Ross, Pearson
(available in the University Library)
Grading :
2 midterms (20% each), 4 homeworks (20%), final (40%).
Warning: Homeworks will require MATLAB coding.
Hence, you are assumed to know (or ready to learn) MATLAB programming.
VF Conditions :
(i) (0.2 *Midterm 1+ 0.2 * Midterm 2 + 0.2*First 3 Homeworks) 40 (over 100)
(ii) Average grade of 2 Midterm exams should be 20 (over 100)
are required to take the final exam.
Otherwise VF (instead of FF) will be given.
No make-up exam (b
ut
unleme) will be given for VF.
Attendance will not be recorded.
Webpage :
[Link]
All lecture announcements, grades and assignments will be published in the Ninova system.
Learning Objectives of the Course:
1. Define laws and axioms of probability and be able to work with set theoretical rules of events
and probabilities
2. Construct probabilities and conditional probabilities; use them in Bayes law to model simple
real life problems
3. Know and utilize random variables (r.v.s), important standard models of probability density
functions (pdfs) and cumulative density functions in both continuous and discrete space
4. Express multiple r.v.s with joint pdfs, relating to marginal pdfs and conditional pdfs, as well
as to concepts of independence and correlatedness
5. Estimate means, variances, covariances, moments of random variables and random vectors
6. Calculate best predictors in minimum mean squared sense both for linear and nonlinear predictors
7. Know the meaning and implications of limit theorems : Law of large numbers and Central
limit theorem
8. Define random processes, their properties as well as standard random process models such as
Gaussian, Poisson, and Markov processes.
Tentative Schedule
Week
Date
Topics
Sept 20
Introduction,set theory,
Sept 27
axioms of probability, binomial law
Oct 4
conditional probability, Independence, random variables
Oct 11
Bayes theorem
Deadline for homework #1
Oct 18
Prof. Unal away at conference (Uygulama)
Oct 25
probability density function, cumulative density functions (discrete and continuous)
Nov 1
Midterm 1
Nov 8
Semester break
Nov 15
Standard probability distributions, Expectation and variance, moments
Deadline for homework #2
10
Nov 22
Multivariate random variables, joint/marginal/conditional distribution, covariance
11
Nov 29
Correlation, independence, Random vectors, multivariate normal distr.
12
Dec 6
Limit theorems: weak law of large numbers, central limit theorem
Deadline for homework #3
13
Dec 13
Midterm 2
14
Dec 20
Random processes, autocorrelation, autocovariance, stationarity (wide/strict sense)
15
Dec 27
Special random processes (Gaussian, Wiener, Markov, Poisson)
Deadline for homework #4