(a) Is the Markov chain with transition matrix 0.5 0.2 0.3 0.1 0.9 0 0 0 1 irreducible? Explain. (b) Does the Markov chain with transition matrix 0.3 0.4 0.3 0.4 0.3 0.3 0.3 0.3 0.4 have an invariant probability distribution? If yes, find that distribution exactly (that is, do not round your answer). If no, explain why it doesn't have one.

(a) Is the Markov chain with transition matrix 0.5 0.2 0.3 0.1 0.9 0 0 0 1 irreducible? Explain. (b) Does the Markov chain with transition matrix 0.3 0.4 0.3 0.4 0.3 0.3 0.3 0.3 0.4 have an invariant probability distribution? If yes, find that distribution exactly (that is, do not round your answer). If no, explain why it doesn't have one.

Elementary Linear Algebra (MindTap Course List)

8th Edition

ISBN:9781305658004

Author:Ron Larson

Publisher:Ron Larson

Chapter2: Matrices

Section2.5: Markov Chain

Problem 49E: Consider the Markov chain whose matrix of transition probabilities P is given in Example 7b. Show...

See similar textbooks