
A First Course in Probability (10th Edition)
10th Edition
ISBN: 9780134753119
Author: Sheldon Ross
Publisher: PEARSON
expand_more
expand_more
format_list_bulleted
Question

Transcribed Image Text:This is for a Linear Algebra class. Please provide explanations for the answer
(3) In the casino game of roulette, a ball is spun around a wheel with 38 slots, 18 of which
are colored black. If you bet on black, then you gain a profit of $1 if the ball lands on
one of the 18 black slots, but you lose $1 if it lands on one of the other 20 slots
(a) Write out the transition matrix for a Markov Chain representing how much money
you have in your pocket before and after a single play of roulette assuming that
you will start with less than $10 and stop once you get to either $0 or $10. For
example, if you have $4 at some point in the night, then you will either have $5 or
S3 after the next round depending on whether black comes up or not, but if you
get to $0 or $10 at any point, you stop playing
(b) Calculate the eigenvalues of your transition matrix and identify all possible sta-
tionary distributions. Discuss convergence (unique for any initial? fail to converge?
etc.
(c) Suppose that you start the night with S5. Calculate the probability that you double
your money before losing it all (i.e. probability that you end the night with S10
instead of $0)
Expert Solution

This question has been solved!
Explore an expertly crafted, step-by-step solution for a thorough understanding of key concepts.
This is a popular solution
Trending nowThis is a popular solution!
Step by stepSolved in 7 steps with 6 images

Knowledge Booster
Similar questions
- Central topic markov chains: Every summer the Yates de los Lagos owners association decides if its annual regatta will be held in June, July or August. If it takes place in June, the probability of good weather is ¾; and if these conditions exist, the regatta of the next year it will be done in June with probability 2/3, in July with probability 1/6 or in August with probability 1/6; but if there is bad weather, next year's regatta will take place in July or August with equal probabilities. If the competition is held in July, good and bad weather have equal probabilities; if there is good weather, the next year's regatta will be held in July; If there is bad weather, the next regatta will take place in August with probability of 2/3 or in June with probability of 1/3. If the regatta takes place in August, the probability of good weather is 2/5; and if there are good conditions atmospheric conditions, next year's regatta will take place in July or August, with equal probabilities; but…arrow_forwardTOPIC: MARKOV CHAINS A housewife always uses one of three brands of detergent: "A", "B" or "C". Which one she buys depends inwhich of the three manufacturers is running a promotional campaign (with gifts such as combs, ornaments, etc.),etc.). Companies undertake such campaigns at random, regardless of whether or not competitors are running other campaigns at the same time.not running other campaigns at the same time. Brand "A" company runs a campaign ½ of the time, brand "B" runs a campaign 1/3 of the time, and brand "B" runs a campaign 1/3 of the time, and brand "C" runs a campaign 1/3 of the time.1/3 of the time, and "C" promotes 1/3 of the time. If the lady buys brand "A" on a certain occasion, the next time she will also buy brand "A".If she buys brand "A" on a certain occasion, the next time she will also buy brand "A", if your company is promoting or if neither of the other two is doing so.or she buys brand "B" if it is on promotion, but brand "A" is not, or she buys brand "C" if…arrow_forwardShow full answers and steps to part d) and e) using Markov Chain Theory. Please explain how you get to the answers without using excel, R or stataarrow_forward
- A bus containing 100 gamblers arrives in Las Vegas on a Monday morning. The gamblers play only poker or blackjack, and never change games during the day. The gamblers' daily choice of game can be modeled by a Markov chain: 95% of the gamblers playing poker today will play poker tomorrow, and 80% of the gamblers playing blackjack today will play blackjack tomorrow. (a) Write down the stochastic (Markov) matrix corresponding to this Markov chain. (b) If 60 gamblers play poker on Monday, how many gamblers play blackjack on Tuesday? (c) Find the unique steady-state vector for the Markov matrix in part (a).arrow_forwardIn an office complex of 1000 employees, on any given day some are at work and the rest are absent. It is known that if an employee is at work today, there is an 85% chance that she will be at work tomorrow, and if the employee is absent today, there is a 70% chance that she will be absent tomorrow. Suppose that today there are 740 employees at work. (A graphing calculator is recommended.) (a) Find the transition matrix A for this scenario. at work absent A = (b) Predict the number that will be at work five days from now. (Round your answer to the nearest integer.) employees (c) Find the steady-state vector x. (Round your answer to two decimal places.)arrow_forwardne bets $1. 0.45, he wins the game and with probability 1 - p = 0.55, he loses the game. His goal is to increase his capital to $3, and as soon as he does, the game is over. The game is also over if his capital is reduced to zero. Construct an absorbing Markov chain and answer the following questions. • What is the expected duration of the game? • What is the probability that he goes broke?arrow_forward
- The main topic is Markov Chains:Students in Geology class never know what is going to happen in the class, as the teacher may: give them a pop quiz, take them to field practice, analyze the topic of the day, or lecture on a special topic.If one day there is a test, the next day there is always a field practice.If one day there is field practice, the next day there is no practice or test, but there is still a chance of the day's topic or special lecture.of the day or of the special lecture.If on a certain day the topic is tested, the probabilities for the next day are ¼ for the test, 1/6 for the topic and 1/3 for the lecture.and 1/3 for the lecture.If one day there is a lecture, the odds for the next day are ¼ for the test, 1/8 for the practice, 1/8 for the topic analysis and ½ for the lecture.for the analysis of the topic and ½ for the lecture.One of the students has calculated that they can expect quizzes 43/287 of the lecture days; field practice72/287 of the class days; topic…arrow_forwardIn any given day the air quality in a certain city is either good or bad. Records show that when the air quality is good on one day, then there is a 95% chance that it will be good the next day, and when the air quality is bad on one day, then there is 45% chance it will be bad the next day. a. Give the transition matrix. b. if the air quality is good today, what is the probability it will be good two days from now? c. if the air quality is bad today, what is the probability it will be bad three days from now? d. if the there is 20% chance the air quality is good today, what is the probability it will be good tomorrow?arrow_forward
arrow_back_ios
arrow_forward_ios
Recommended textbooks for you
- A First Course in Probability (10th Edition)ProbabilityISBN:9780134753119Author:Sheldon RossPublisher:PEARSON

A First Course in Probability (10th Edition)
Probability
ISBN:9780134753119
Author:Sheldon Ross
Publisher:PEARSON
