# mdp: Tools for solving Markov Decision Processes.

A library for formulating and solving Markov decision problems. We currently only solve infinite horizon problems. We handle discounted and undiscounted problems, and can solve continuous- and discrete-time problems.

Versions [faq] | 0.1.0.0, 0.1.1.0 |
---|---|

Dependencies | base (>=4.8 && <4.10), containers (>=0.5.8.1 && <0.6), mdp, vector (==0.11.*) [details] |

License | MIT |

Author | Patrick Steele |

Maintainer | prs233@cornell.edu copyright: Copyright (c) 2015-2016 Patrick Steele |

Category | Algorithms, Math |

Source repo | head: git clone https://github.com/prsteele/mdp.git |

Uploaded | by prsteele at Tue Nov 29 18:36:45 UTC 2016 |

Distributions | NixOS:0.1.1.0 |

Executables | mm1, ex-3-2, ex-3-1-relative, ex-3-1 |

Downloads | 704 total (27 in the last 30 days) |

Rating | (no votes yet) [estimated by rule of succession] |

Your Rating | |

Status | Docs uploaded by user Build status unknown [no reports yet] |

## Modules

[Index]

## Downloads

- mdp-0.1.1.0.tar.gz [browse] (Cabal source package)
- Package description (as included in the package)