Symmetry. The distinct pair i, j of states of a Markov chain is called symmetric if P(Tj < Ti | Xo = i) = P(Ti < Tj | Xo = j), where Ti = min {n ≥ 1: Xn=i}. Show that, if Xo = i and i, j is symmetric, the expected number of visits to j before the chain revisits i i is 1.

Linear Algebra: A Modern Introduction
4th Edition
ISBN:9781285463247
Author:David Poole
Publisher:David Poole
Chapter3: Matrices
Section3.7: Applications
Problem 2EQ
icon
Related questions
Question
Symmetry. The distinct pair i, j of states of a Markov chain is called symmetric if
P(Tj < Ti | Xo = i) = P(Ti < Tj | Xo = j),
where Ti = min {n ≥ 1: Xn=i}. Show that, if Xo = i and i, j is symmetric, the expected number
of visits to j before the chain revisits i
i is 1.
Transcribed Image Text:Symmetry. The distinct pair i, j of states of a Markov chain is called symmetric if P(Tj < Ti | Xo = i) = P(Ti < Tj | Xo = j), where Ti = min {n ≥ 1: Xn=i}. Show that, if Xo = i and i, j is symmetric, the expected number of visits to j before the chain revisits i i is 1.
Expert Solution
trending now

Trending now

This is a popular solution!

steps

Step by step

Solved in 3 steps with 3 images

Blurred answer