Consider the Markov chain with three states,S={1,2,3}, that has the following transition matrix   P=     Draw the state transition diagram for this chain.  If we know P(X1=1) =P(X1=2) =1/4, find P(X1=3, X2=2,X3=1)

Operations Research : Applications and Algorithms
4th Edition
ISBN:9780534380588
Author:Wayne L. Winston
Publisher:Wayne L. Winston
Chapter17: Markov Chains
Section: Chapter Questions
Problem 15RP
icon
Related questions
Question
100%
  1. Consider the Markov chain with three states,S={1,2,3}, that has the following transition matrix

 

P=

 

 

  1. Draw the state transition diagram for this chain. 
  2. If we know P(X1=1) =P(X1=2) =1/4, find P(X1=3, X2=2,X3=1)  
Expert Solution
trending now

Trending now

This is a popular solution!

steps

Step by step

Solved in 2 steps with 1 images

Blurred answer
Knowledge Booster
Uncertainty Problems
Learn more about
Need a deep-dive on the concept behind this application? Look no further. Learn more about this topic, computer-science and related others by exploring similar questions and additional content below.
Similar questions
  • SEE MORE QUESTIONS
Recommended textbooks for you
Operations Research : Applications and Algorithms
Operations Research : Applications and Algorithms
Computer Science
ISBN:
9780534380588
Author:
Wayne L. Winston
Publisher:
Brooks Cole