Consider a game where you need to fill a 5-digit number by spinning a wheel. Every time you spin the wheel a random digit shows up between 0 – 9 with equal probability. You are to decide where to place the digit in your number. Once you choose a location for the digit you cannot change it. Your objective is to maximize the number you get. (a) Set this up as a Markov Decision Process, identify the states, actions, and transition matrices.

Consider a game where you need to fill a 5-digit number by spinning a wheel. Every time you spin the wheel a random digit shows up between 0 – 9 with equal probability. You are to decide where to place the digit in your number. Once you choose a location for the digit you cannot change it. Your objective is to maximize the number you get. (a) Set this up as a Markov Decision Process, identify the states, actions, and transition matrices.

Linear Algebra: A Modern Introduction

4th Edition

ISBN:9781285463247

Author:David Poole

Publisher:David Poole

Chapter3: Matrices

Section3.7: Applications

Problem 9EQ

See similar textbooks