Consider the Markov chain whose state diagram is given by 3 1/2 1/2/ 1/4 2 1 1/4 1/2 4

Linear Algebra: A Modern Introduction
4th Edition
ISBN:9781285463247
Author:David Poole
Publisher:David Poole
Chapter3: Matrices
Section3.7: Applications
Problem 17EQ
icon
Related questions
Question
Consider the Markov chain whose state diagram is given by
1/2
1/2
1/4
1
1/4
1/2
Given that Xo 3, what is the expected (average) number of steps before
being absorbed (into state 1 or into state 2)?
Hint: You may want to use the first step principle OR you may want to use
the fact that for this chain, the transition matrix is
0.
0.
0.
%3D
1/2
1/2
1/4 1/2 1/4
0.
0.
Select one:
O A. 14/5
O B. 7/5
O C. 9/5
O D. 12/5
O E. 6/5
Transcribed Image Text:Consider the Markov chain whose state diagram is given by 1/2 1/2 1/4 1 1/4 1/2 Given that Xo 3, what is the expected (average) number of steps before being absorbed (into state 1 or into state 2)? Hint: You may want to use the first step principle OR you may want to use the fact that for this chain, the transition matrix is 0. 0. 0. %3D 1/2 1/2 1/4 1/2 1/4 0. 0. Select one: O A. 14/5 O B. 7/5 O C. 9/5 O D. 12/5 O E. 6/5
Expert Solution
steps

Step by step

Solved in 2 steps

Blurred answer