1. A machine can be in one of four states: 'running smoothly' (state 1), 'running but needs adjustment' (state 2), 'temporarily broken' (state 3), and 'destroyed' (state 4). Each morning the state of the machine is recorded. Suppose that the state of the machine tomorrow morning depends only on the state of the machine this morning subject to the following rules. • If the machine is running smoothly, there is 1% chance that by the next morning it will have exploded (this will destroy the machine), there is also a 9% chance that some part of the machine will break leading to it being temporarily broken. If neither of these things happen then the next morning there is an equal probability of it running smoothly or running but needing adjustment. • If the machine is temporarily broken in the morning then an engineer will attempt to repair the machine that day, there is an equal chance that they succeed and the machine is running smoothly by the next day or they fail and cause the machine to explode. If the machine is running but needing adjustment there is a 20% chance that an engineer will repair it so it is running smoothly the next day and otherwise it will remain in the same state for the next day. Taking X, to be the state of the machine on the morning of day i for i E N we get a Markov chain which models the state of the machine.
1. A machine can be in one of four states: 'running smoothly' (state 1), 'running but needs adjustment' (state 2), 'temporarily broken' (state 3), and 'destroyed' (state 4). Each morning the state of the machine is recorded. Suppose that the state of the machine tomorrow morning depends only on the state of the machine this morning subject to the following rules. • If the machine is running smoothly, there is 1% chance that by the next morning it will have exploded (this will destroy the machine), there is also a 9% chance that some part of the machine will break leading to it being temporarily broken. If neither of these things happen then the next morning there is an equal probability of it running smoothly or running but needing adjustment. • If the machine is temporarily broken in the morning then an engineer will attempt to repair the machine that day, there is an equal chance that they succeed and the machine is running smoothly by the next day or they fail and cause the machine to explode. If the machine is running but needing adjustment there is a 20% chance that an engineer will repair it so it is running smoothly the next day and otherwise it will remain in the same state for the next day. Taking X, to be the state of the machine on the morning of day i for i E N we get a Markov chain which models the state of the machine.
Linear Algebra: A Modern Introduction
4th Edition
ISBN:9781285463247
Author:David Poole
Publisher:David Poole
Chapter2: Systems Of Linear Equations
Section2.4: Applications
Problem 28EQ
Related questions
Question
Expert Solution
This question has been solved!
Explore an expertly crafted, step-by-step solution for a thorough understanding of key concepts.
Step by step
Solved in 4 steps with 21 images
Recommended textbooks for you
Linear Algebra: A Modern Introduction
Algebra
ISBN:
9781285463247
Author:
David Poole
Publisher:
Cengage Learning
Algebra & Trigonometry with Analytic Geometry
Algebra
ISBN:
9781133382119
Author:
Swokowski
Publisher:
Cengage
Algebra for College Students
Algebra
ISBN:
9781285195780
Author:
Jerome E. Kaufmann, Karen L. Schwitters
Publisher:
Cengage Learning
Linear Algebra: A Modern Introduction
Algebra
ISBN:
9781285463247
Author:
David Poole
Publisher:
Cengage Learning
Algebra & Trigonometry with Analytic Geometry
Algebra
ISBN:
9781133382119
Author:
Swokowski
Publisher:
Cengage
Algebra for College Students
Algebra
ISBN:
9781285195780
Author:
Jerome E. Kaufmann, Karen L. Schwitters
Publisher:
Cengage Learning