Show that an irreducible MC is aperiodic if there is at least one positive element on the main diagonal of its TPM. Hint. Let X be an irreducible MC with a TPM P = p² Pi ... Pii I where Pii > 0. Then, where på > (pii)² > 0 (explain why?). By induction, p>0, implying that the set of returns to state i counted in number of steps is not only countable but actually equals N. Therefore the GCD of all those return numbers equals 1 implying that state į is aperiodic. Because periodicity is a class-relation, we conclude that X is aperiodic. In fact, it turns out that p > 0 for all n.

Algebra & Trigonometry with Analytic Geometry
13th Edition
ISBN:9781133382119
Author:Swokowski
Publisher:Swokowski
Chapter4: Polynomial And Rational Functions
Section4.2: Properties Of Division
Problem 52E
icon
Related questions
Question
Show that an irreducible MC is aperiodic if there is at least one positive element on the main
diagonal of its TPM.
Hint. Let X be an irreducible MC with a TPM P =
p² =
Pii
Pii
7
where Pii > 0. Then,
where p > (Pii)² > 0 (explain why?). By induction, p > 0, implying that the set of returns to state i
counted in number of steps is not only countable but actually equals N. Therefore the GCD of all those
return numbers equals 1 implying that state i is aperiodic. Because periodicity is a class-relation, we
conclude that X is aperiodic. In fact, it turns out that p > 0 for all n.
Transcribed Image Text:Show that an irreducible MC is aperiodic if there is at least one positive element on the main diagonal of its TPM. Hint. Let X be an irreducible MC with a TPM P = p² = Pii Pii 7 where Pii > 0. Then, where p > (Pii)² > 0 (explain why?). By induction, p > 0, implying that the set of returns to state i counted in number of steps is not only countable but actually equals N. Therefore the GCD of all those return numbers equals 1 implying that state i is aperiodic. Because periodicity is a class-relation, we conclude that X is aperiodic. In fact, it turns out that p > 0 for all n.
Expert Solution
steps

Step by step

Solved in 3 steps with 14 images

Blurred answer
Recommended textbooks for you
Algebra & Trigonometry with Analytic Geometry
Algebra & Trigonometry with Analytic Geometry
Algebra
ISBN:
9781133382119
Author:
Swokowski
Publisher:
Cengage
Elements Of Modern Algebra
Elements Of Modern Algebra
Algebra
ISBN:
9781285463230
Author:
Gilbert, Linda, Jimmie
Publisher:
Cengage Learning,
Linear Algebra: A Modern Introduction
Linear Algebra: A Modern Introduction
Algebra
ISBN:
9781285463247
Author:
David Poole
Publisher:
Cengage Learning