Let (Yo, Y₁, Y2,...) be a new discrete-time homogeneous Markov chain on the same state space obtained by modifying this chain as follows. At each time I toss a biased coin which has probability 1/3 of showing Heads. If it shows a Head then I take one step in the chain with transition matrix P; if it shows a Tail I remain in the same state. Let Q be the transition matrix for (Yo, Y₁, Y2, ...). (e) Write down the matrix Q. (f) Does this Markov chain have a limiting distribution? Justify your answer.

Algebra & Trigonometry with Analytic Geometry
13th Edition
ISBN:9781133382119
Author:Swokowski
Publisher:Swokowski
Chapter1: Fundamental Concepts Of Algebra
Section1.4: Fractional Expressions
Problem 66E
icon
Related questions
Question

Let (X0, X1, X2, . . .) be the discrete-time, homogeneous Markov chain on state space S = {1, 2, 3, 4, 5, 6} with X0 = 1 and transition matrix

P =
0
0
0
0
0
0
0 0
1/2 1/2
1/2 1/2
1/3 2/3 0
1/3 2/3
0
0 0 3/4 1/4
0 0
0
1/4 3/4
0
0
0
0
000
0
0
Transcribed Image Text:P = 0 0 0 0 0 0 0 0 1/2 1/2 1/2 1/2 1/3 2/3 0 1/3 2/3 0 0 0 3/4 1/4 0 0 0 1/4 3/4 0 0 0 0 000 0 0
Let (Yo, Y₁, Y2,...) be a new discrete-time homogeneous Markov chain on the same
state space obtained by modifying this chain as follows. At each time I toss a biased
coin which has probability 1/3 of showing Heads. If it shows a Head then I take one
step in the chain with transition matrix P; if it shows a Tail I remain in the same state.
Let Q be the transition matrix for (Yo, Y₁, Y2,...).
(e) Write down the matrix Q.
(f) Does this Markov chain have a limiting distribution? Justify your answer.
Transcribed Image Text:Let (Yo, Y₁, Y2,...) be a new discrete-time homogeneous Markov chain on the same state space obtained by modifying this chain as follows. At each time I toss a biased coin which has probability 1/3 of showing Heads. If it shows a Head then I take one step in the chain with transition matrix P; if it shows a Tail I remain in the same state. Let Q be the transition matrix for (Yo, Y₁, Y2,...). (e) Write down the matrix Q. (f) Does this Markov chain have a limiting distribution? Justify your answer.
Expert Solution
steps

Step by step

Solved in 4 steps with 13 images

Blurred answer
Similar questions
  • SEE MORE QUESTIONS
Recommended textbooks for you
Algebra & Trigonometry with Analytic Geometry
Algebra & Trigonometry with Analytic Geometry
Algebra
ISBN:
9781133382119
Author:
Swokowski
Publisher:
Cengage
College Algebra (MindTap Course List)
College Algebra (MindTap Course List)
Algebra
ISBN:
9781305652231
Author:
R. David Gustafson, Jeff Hughes
Publisher:
Cengage Learning