Department of Mathematics
Acharya Institute of Technology
Affiliated to VTU, Recognized by GOK and Approved by AICTE, New Delhi (Accredited by NAAC)
Acharya Dr. Sarvepalli Radhakrishnan Road, Acharya P.O., Soladevanahalli, Bangalore-560107
[Link], Email: hod-maths@[Link]
Question Bank
Subject with Code: Mathematics for Computer Science (BCS301)
Academic Year / Semester: 2025-26 / III Sem
Module 2: Joint probability distribution & Markov Chains
1. The joint probability distribution for two random variables X and Y as follows:
X \ Y -2 -1 4 5
1 0.1 0.2 0 0.3
2 0.2 0.1 0.3 0
Find (a) marginal distributions of 𝑋 and 𝑌 (b) Expectations of X, Y, XY (c) SD of X and Y (d)
Covariance of X and Y (e) Correlation of X and Y (f) Are X and Y independent ?
(June/July-2019, Jan-2024, Jan 2025)
2. The joint probability distribution for two random variables X and Y as follows:
X \ Y -3 2 4
1 0.1 0.2 0.2
3 0.3 0.1 0.1
Find (a) marginal distributions of 𝑋 and 𝑌 (b) Covariance of X and Y (e) Correlation of X
and Y. (June/July- 2018)
3. The joint probability distribution for two random variables X and Y as follows:
X \ Y -4 2 7
1 1/8 ¼ 1/8
5 ¼ 1/8 1/8
Compute (i) E(X) and E(Y) (ii) E(XY) (iii) COV(X,Y) (iv) 𝜌(𝑋, 𝑌) (June/July- 2018)
4. The joint probability distribution for two random variables X and Y are given. Find the
corresponding marginal distributions. Also compute the covariance and correlation of the
random variables X and Y.(June/July- 2019, June-2024)
X \Y 1 3 9
2 1/8 1/24 1/12
4 1/4 1/4 0
6 1/8 1/24 1/12
Department of Mathematics Page 1
Department of Mathematics
Acharya Institute of Technology
Affiliated to VTU, Recognized by GOK and Approved by AICTE, New Delhi (Accredited by NAAC)
Acharya Dr. Sarvepalli Radhakrishnan Road, Acharya P.O., Soladevanahalli, Bangalore-560107
[Link], Email: hod-maths@[Link]
5. Find the joint probability distribution of the independent random variables with the
following marginal.
X=x -2 5 8 X=x 1 2
P(X = x) 0.3 0.5 0.2 P(X = x) 0.7 0.3
6. A fair coin is tossed 3 times. Let X denotes 0 or 1 as a tail or head occurs on the first toss.
Let Y denote the total number of tails which occur. Determine(a) marginal distributions of
X and Y (b) Joint distribution of X and Y (c) COR(X,Y) ( July-2024)
7. Two marbles are drawn from a box containing 3 blue, 2 red and 3 green marbles. Let X
and Y be number of blue and red marbles selected respectively. Find (a) Joint distribution
of X and Y (b) 𝑃(𝑋 + 𝑌 ≤ 1) (c) Correlation between X and Y.
8. Determine the value of k so that the function f(x, y) = k |x − y|, for x = −2, 0, 2;
y = −2, 3 represents joint probability distribution of the random variables X and Y. Also
determine cov(X, Y).
9. The Joint probability distribution of two discrete random variables x and y is given by
f(x,y)=k(2x+y) where x and y are integers such that 0 ≤ 𝑥 ≤ 2, 0 ≤ 𝑥 ≤ 3
(i) Find the value of the constant k
(ii) Find the marginal probability distribution of X and Y
(iii) Show that the random variables X and Y are dependent.
1
10. The Joint probability distribution of x and y is given by 𝑓(𝑥, 𝑦) = 30 (𝑥 + 𝑦) for
x=0,1,2,3; y=0,1,2. Find (i) P (x≤2, y=1) ii) P(x > y) (Jan-2025)
11. The joint probability function of two discrete random variables X and Y is given by
f ( x, y ) = cxy for x =1,2,3 and y = 1,2,3. Find the following.
i) a constant c ii) P( X = 2, Y = 3) iii) 𝑃(1 ≤ 𝑋 ≤ 2, 𝑌 ≤ 2) iv) P( X 2)
12. A salesman territory consists of three cities A, B and C. He never sells in the same city on
successive days. If he sells in A, then the next day he sells in city B. However, if he sells
in either B or C, the next day he is twice as likely to sell in the city A as in the other city.
In the long run, how often does he sell in each of the cities? (June-2024)
13. Three boys X, Y, Z are throwing a ball to each other. X always throws the ball to Y & Y
always throws the ball to Z. But Z is just as likely to throw the ball to Y or as to X. Write
TPM if Z is the first person to throw the ball, find the probability that X has the ball after
fourth throw.
14. The students study habits are as follows; If he studies on one night, he is 60% sure not to
study on next night. On the other hand, if he does not study on to night, he is 80% sure
to study next night. Write the transition probability matrix for his chain of study. In the
Department of Mathematics Page 2
Department of Mathematics
Acharya Institute of Technology
Affiliated to VTU, Recognized by GOK and Approved by AICTE, New Delhi (Accredited by NAAC)
Acharya Dr. Sarvepalli Radhakrishnan Road, Acharya P.O., Soladevanahalli, Bangalore-560107
[Link], Email: hod-maths@[Link]
long run how often does he study? Suppose he studies on Monday night, what is the
probability that he does not study on Friday night?
15. Each year a man trades his car for a new car in 3 brands of the popular company. If he has a ‘swift’
he trades it for ‘Dzire’. If he has a ‘Dzire’ he trades it for a ‘Wagnor’. If he has a ‘Wagnor’ he is just
as likely to trade it for a new ‘Wagnor’ or for a ‘Dzire’ or a ‘Swift’ one. In 2020 he bought his first
car which was ‘Wagnor’. Find the probability that he has
(i) 2022 Wagnor.
(ii) 2022 Swift.
(iii) 2023 Dzire.
(iv) 2023 Wagnor. (Jan-2024)
16. Define (i) probability vector, (ii) regular stochastic matrix, (iii) fixed probability vector.
(June-2024)
17. A software engineer goes to his work every day by the motor bike or by car. He never
goes by bike on two consecutive days but if he goes by car on a day, then he is equally
likely to go by car or by bike on the next day. Find the transition matrix for the chain of
the mode of transport he uses. If car is used on the first day of week find the probability
that (i) bike is used (ii) car is used of the fifth day.
18. Discuss i)Absorbing state ii) transient state recurrence state by means of an example each.
19. A man’s gambling luck follows a pattern. If he wins a game the probability of winning the
next game is 0.6. However, if he loses a game the probability of loss in the next game is
0.7. There is an even chance that he wins the first game. (i) Find the transition matrix for
the Markov process. (ii) Find the probability that he wins the second game. (iii) Find out
how often in the long run he wins. (Jan-2025)
20. Find the fixed probability vector of the regular stochastic matrix
0.5 0.25 0.25
0.5 0.0 0.5
0 1 0
21. A company changes his car every year if he has a car of make A he changes over to make
B. From Make B he changes to make C. If he has a car of make C, then he gives equal
preference to change over to make A or Make B car. If he had a car of make C in year
2008, find the probability that he will have a car of (i) make A in 2010 (i) make C in 2010
22. Verify the matrix A is a regular stochastic matrix
0 0 1
0.5 0.25 0.25
0 1 0
23. Find the fixed probability vector of the regular stochastic matrix (Jan-2024)
Department of Mathematics Page 3
Department of Mathematics
Acharya Institute of Technology
Affiliated to VTU, Recognized by GOK and Approved by AICTE, New Delhi (Accredited by NAAC)
Acharya Dr. Sarvepalli Radhakrishnan Road, Acharya P.O., Soladevanahalli, Bangalore-560107
[Link], Email: hod-maths@[Link]
0 1 0
0 0 1
0.5 0.5 0
24. Find the fixed probability vector of the regular stochastic matrix
0 1 0
0.5 0.0 0.5
0.5 0.25 0.25
25. Show that the following matrix is a regular stochastic matrix (Jan-2025)
0 0 1
[1/2 0 1/2]
0 1 0
26. A man trades his car every year for a new car. If he has a car of Maruti he changes over to
Ambassador. From Ambassador he changes to Santro. However if he has a Santro, then he
is like to trade if for a new Santro, or Maruti or Ambassador Car. If he had a car of Santro
in year 2000, find the probability that he will have a car (i) Maruti in 2002 (i) Santro in
2003
27. Find the fixed probability vector of the regular stochastic matrix (Jan-2024)
0 1 0
1 1 1
[ ]
6 2 3
0 2/3 1/3
28. Find the unique fixed probability vector of the regular stochastic matrix (Jan-2024, Jan-
2025)
0 1 0
[1/6 1/2 1/3]
0 2/3 1/3
29. Three students A, B and C are playing a game throwing a ball. A always throws to B and
B always throws to C. However, C is likely to throw to A or B equally likely. If C has the
ball, find the probability that each of them may have the ball after three throws. (Jan-2024)
30. Three boys A, B and C are throwing a ball to each other. A always throws to B. B always
throw the ball to A and C is just as likely to throw the ball to A as to B. Find the
probability that C has the ball after three throws, if C starts the game. (Jan-2025)
31. Show that the Markov chain whose transition probability matrix is irreducible. Also find
the corresponding stationary probability vector.
0 2/3 1/3
Department of Mathematics Page 4
Department of Mathematics
Acharya Institute of Technology
Affiliated to VTU, Recognized by GOK and Approved by AICTE, New Delhi (Accredited by NAAC)
Acharya Dr. Sarvepalli Radhakrishnan Road, Acharya P.O., Soladevanahalli, Bangalore-560107
[Link], Email: hod-maths@[Link]
½ 0 ½
½ ½ 0
Department of Mathematics Page 5