mdp-0.1.0.0: Tools for solving Markov Decision Processes.

Safe HaskellNone
LanguageHaskell98

Algorithms.MDP.Examples.MM1

Description

We model an MM1 queue, i.e. a single-server queue with Poisson arrivals and service times.

See "Stochastic Dynamic Programming and the Control of Queueing Systems", Linn I. Sennot,, p. 242 for details.

Synopsis

Documentation

data Scenario Source

A description of an MDP.

newtype State Source

The state space is the count of customers in the queue.

Constructors

State Int 

data Action Source

There are a number of services we can provide each customer, and if there are no customers we do nothing.

Constructors

NullAction 
Action Int 

mkInstance :: Scenario -> CTMDP State Action Double Source

Generate an MDP from a Scenario.

scenario1 :: Scenario Source

A specific scenario.

scenario2 :: Scenario Source

A specific scenario.

scenario3 :: Scenario Source

A specific scenario.

scenario4 :: Scenario Source

A specific scenario.

scenario5 :: Scenario Source

A specific scenario.

scenario6 :: Scenario Source

A specific scenario.

scenario7 :: Scenario Source

A specific scenario.

scenario8 :: Scenario Source

A specific scenario.