1. Assume X are independent and identically distributed with P(X₁ = 1) = p, P(X₁ = 0) = r and P(X₁ -1) = q. where p, r,q > 0 and p+r+ q = 1. = Let Sn=Xi, n = 1, 2, . . .. (a) Prove that {S1, S2,...} is an irreducible Markov chain with state space S = {0,±1, ±2, ...} and write down its transition matrix. (b) Is the chain aperiodic? (c) Find expressions for: i. P(S3 = 2). ii. P(S₁ = 1|S₁ = 1). iii. P(S10=1|S7 = 0). iv. ES and var(Sn).

Linear Algebra: A Modern Introduction
4th Edition
ISBN:9781285463247
Author:David Poole
Publisher:David Poole
Chapter6: Vector Spaces
Section6.5: The Kernel And Range Of A Linear Transformation
Problem 14EQ
icon
Related questions
Question
100%

Please do not rely too much on chatgpt, because its answer may be wrong. Please consider it carefully and give your own answer. You can borrow ideas from gpt, but please do not believe its answer.Very very grateful!Please do not rely too much on chatgpt, because its answer may be wrong. Please consider it carefully and give your own answer. You can borrow ideas from gpt, but please do not believe its answer. Very very grateful!

 

And please do not copy other's work,very appreciate!!

And please do not copy other's work,very appreciate!!

And please do not copy other's work,very appreciate!!

1. Assume X are independent and identically distributed with P(X₁ = 1) = p,
P(X₁ = 0) = r and P(X₁ -1) = q. where p, r,q > 0 and p+r+ q = 1.
=
Let Sn=Xi, n = 1, 2, . . ..
(a) Prove that {S1, S2,...} is an irreducible Markov chain with state space S =
{0,±1, ±2, ...} and write down its transition matrix.
(b) Is the chain aperiodic?
(c) Find expressions for:
i. P(S3 = 2).
ii. P(S₁ = 1|S₁ = 1).
iii. P(S10=1|S7 = 0).
iv. ES and var(Sn).
Transcribed Image Text:1. Assume X are independent and identically distributed with P(X₁ = 1) = p, P(X₁ = 0) = r and P(X₁ -1) = q. where p, r,q > 0 and p+r+ q = 1. = Let Sn=Xi, n = 1, 2, . . .. (a) Prove that {S1, S2,...} is an irreducible Markov chain with state space S = {0,±1, ±2, ...} and write down its transition matrix. (b) Is the chain aperiodic? (c) Find expressions for: i. P(S3 = 2). ii. P(S₁ = 1|S₁ = 1). iii. P(S10=1|S7 = 0). iv. ES and var(Sn).
Expert Solution
steps

Step by step

Solved in 1 steps

Blurred answer
Recommended textbooks for you
Linear Algebra: A Modern Introduction
Linear Algebra: A Modern Introduction
Algebra
ISBN:
9781285463247
Author:
David Poole
Publisher:
Cengage Learning
Elements Of Modern Algebra
Elements Of Modern Algebra
Algebra
ISBN:
9781285463230
Author:
Gilbert, Linda, Jimmie
Publisher:
Cengage Learning,
Elementary Linear Algebra (MindTap Course List)
Elementary Linear Algebra (MindTap Course List)
Algebra
ISBN:
9781305658004
Author:
Ron Larson
Publisher:
Cengage Learning