0% found this document useful (0 votes)
8 views2 pages

EE 325 Probability Homework Module 2

Copyright
© All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
0% found this document useful (0 votes)
8 views2 pages

EE 325 Probability Homework Module 2

Copyright
© All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd

EE 325: Probability and Random Processes

Homework for Module 2

1. The material in this module is mostly drawn from Chapter 4 of the Papoulis text
and sections 2.1, 2.3–2.5, 2.7, 3.1–3.4. There are several solved examples in both
the books. Make sure you have studied these problems and the solutions.

2. From the Papoulis text, solve problems 4.2, 4.4, 4.11, 4.16, 4.26, 4.31, and 4.33.

3. From the Hajek book, many of the problems at the end of chapters 2 and 3 provide
insights into using probability models in many real life situations. Of course, these
are significantly simplified to make them solvable in reasonable time. Problems
2.8, 2.9, 2.12–2.14, and 2.18–2.21 are some that provide interesting insights. From
Chapter 3, problems 3.4, 3.7, 3.8, 3.10, and 3.16 are good to try.

Additional problems from here and there

4. Let X and Y be random variables on the probability space (Ω, F, P). Show that
Z1 = X + Y, Z2 = X × Y, and Z3 = max{X, Y} are also random variables.

5. F (x) is a valid distribution. Which of the following functions of F (x) are also valid
distributions. Provide a proof for your claim.

(a) aF (x) + (1 − a)F (x) where 0 ≤ a ≤ 1.


(b) (F (x))r
(c) 1 − (1 − F (x))r
(d) F (x) + (1 − F (x)) log(1 − F (x))

6. Claim: If FX (x) is continuous at x = x0 , then Pr(X = x0 ) = 0. Prove or disprove.

7. X is a strictly positive discrete random variable, i.e., it takes values in the set
x
{1, 2, . . . , } and pX (x) is its pmf. If the pmf has the form pX (x) = C∗2
x!
, find the
C∗2−x α
value of C. Repeat for pX (x) = x , and pX (x) = Cx .

8. For the previous problem, find (i) Pr(X > 2) , (ii) most probable value of X.

1
9. There are two urns—A containing n black balls and B containing n brown balls.
At each step, one ball is chosen at random from both urns and swapped, i.e., the
one from A is put into B and vice versa. Let Xm be the number of black balls in
urn A after m steps. Observe that this determines the state of the system after
m steps, i.e., knowing Xm describes the composition of both the urns. Obtain the
mean of Xm . This is a model for diffusion.

10. There are n coins each of which comes up heads with probability p. In round 1,
each coin is tossed once. In round 2, all those coins that came up heads in round 1
are tossed again and others are left unchanged. Let X be the total number of heads
after round 2. Find the pmf of X.

11. Let X be the random variable denoting the number of tosses of a biased coin to get
the first head. The first head has not occurred in the first k tosses. What is the
probability that you will have to toss the coin n more times.

12. A fair die is rolled 6n times. Let ρn be the probability that there n 6s in the 6n
rolls. Is ρn a monotonic function. Prove your statement.

Common questions

Powered by AI

After two rounds, model as a two-step Bernoulli process. Let Y1 and Y2 be heads in rounds 1 and 2, respectively. The pmf is derived by convolution: Pr(X = x) = ∑ Pr(Y1 = y1) * Pr(Y2 = x - y1 | Y1 = y1). Use binomial coefficients for each round: Pr(Y1 = y1) = C(n, y1) * p^y1 * (1-p)^(n-y1), followed by the second round conditional probabilities and summing for all possible initial outcomes .

The probability ρn is derived from the binomial distribution with parameters n = 6n, p = 1/6. To evaluate monotonicity, examine ρn+1 - ρn, and compute using derivatives or differences of binomial coefficients. If the sequence of probabilities is not consistently increasing or decreasing, it is not monotonic, often the case outside of trivial parameter values .

To find the most probable value (mode) of X for pX(x) = Cxα, maximize the pmf over the integers. Start by considering the ratio pX(x+1)/pX(x) = ((x+1)α / xα), and find the x where this ratio is ≤ 1, indicating a peak at x. The specific solution depends on α, but generally, the most probable value will be for x such that the sequence starts decreasing, given the discrete nature .

The probability models presented in the Papoulis and Hajek texts are designed to offer insights into real-life situations by simplifying complex problems to a solvable level. These models serve as abstractions of reality where assumptions are made to reduce complexity, such as considering independence or uniform distributions, which can make analysis feasible even for large systems .

F(x) = aF(x) + (1 − a)F(x) simplifies to F(x), which is a valid distribution because it retains the properties of a cumulative distribution function (CDF), namely being non-decreasing, right continuous, with limits F(-∞) = 0 and F(∞) = 1. This identity transformation does not alter the function's properties as a CDF .

When FX(x) is continuous at x = x0, it implies that the probability mass function does not include an atom at x0, leading to Pr(X = x0) = 0. This results because continuous cumulative distribution functions (CDFs) are linked with random variables that have a probability of zero at any single point, unlike discrete distributions .

Let X be geometrically distributed with parameter p, the probability of heads. The probability of having no heads in k tosses and the first head occurring on the (k+n)th toss is (1-p)^k * p. This indicates the process is memoryless, preserving geometric distribution properties, thus ensuring each new sequence has probability p independent of k .

The normalization constant C can be found by ensuring that the sum of all probabilities equals 1, i.e., ∑(C * 2^x / x!) for x = 1 to ∞ equals 1. This series resembles a Poisson distribution with parameter λ = 2, leading to the conclusion that C = e^-2 to normalize it properly, as for the Poisson distribution, the sum of probabilities is e^λ .

The mean of Xm after m steps can be computed using the transition matrix of the Markov chain model representing the urns' states. Each swap constitutes a transition, affecting the distribution of black balls. Use the expected value through the steady-state distribution, derived from the eigenvectors of the transition matrix .

Z1, Z2, and Z3 are random variables because they are functions of the random variables X and Y, meeting the criteria of measurability within the probability space (Ω, F, P). A function of random variables is itself a random variable provided it is Borel measurable. For Z1 = X + Y, Z2 = X × Y, and Z3 = max{X, Y}, all these operations preserve measurability as they are defined pointwise on the real line .

You might also like