The transition matrix for a Markov process is
and the initial-state distribution
Find
To find:
The vector
Answer to Problem 1BMO
Solution:
The vector
Explanation of Solution
Given:
The transition matrix for a Markov process is
and the initial-state distribution vector is
Approach:
From the given data,
Write the expression of the probability distribution after one observation
Write the expression of the probability distribution after two observations
Calculation:
Substitute
Similarly, Substitute
Conclusion:
Hence, vector
Want to see more full solutions like this?
Chapter 9 Solutions
Finite Mathematics for the Managerial, Life, and Social Sciences
- Linear Algebra: A Modern IntroductionAlgebraISBN:9781285463247Author:David PoolePublisher:Cengage LearningElementary Linear Algebra (MindTap Course List)AlgebraISBN:9781305658004Author:Ron LarsonPublisher:Cengage Learning