Let X be a Markov chain containing an absorbing states with which all other states i communicate, in the sense that pis (n) > 0 for some n = n(i). Show that all states other than s are transient.

Linear Algebra: A Modern Introduction
4th Edition
ISBN:9781285463247
Author:David Poole
Publisher:David Poole
Chapter3: Matrices
Section3.7: Applications
Problem 2EQ
icon
Related questions
Question
Let X be a Markov chain containing an absorbing states with which all other states i communicate,
in the sense that pis (n) > 0 for some n = n(i). Show that all states other than s are transient.
Transcribed Image Text:Let X be a Markov chain containing an absorbing states with which all other states i communicate, in the sense that pis (n) > 0 for some n = n(i). Show that all states other than s are transient.
Expert Solution
steps

Step by step

Solved in 2 steps with 2 images

Blurred answer