Markov decision processes (mdp) toolbox in matlab

The following Matlab project contains the source code and Matlab examples used for markov decision processes (mdp) toolbox. The MDP toolbox proposes functions related to the resolution of discrete-time Markov Decision Processes: backwards induction, value iteration, policy iteration, linear programming algorithms with some variants.

The source code and files included in this project are listed in the project files section, please make sure whether the listed source code meet your needs there.

Project Files: 

File NameSize
license.txt 1304
AUTHORS 63
COPYING 1563
arrow.gif 231
DOCUMENTATION.html 3808
index_alphabetic.html 6469
index_category.html 7022
mdp_bellman_operator.html 3180
mdp_check.html 2959
mdp_check_square_stochastic.html 2465
mdp_computePpolicyPRpolicy.html 3357
mdp_computePR.html 2885
mdp_eval_policy_iterative.html 7506
mdp_eval_policy_matrix.html 2984
mdp_eval_policy_optimality.html 3691
mdp_eval_policy_TD_0.html 3363
mdp_example_forest.html 6834
mdp_example_rand.html 3833
mdp_finite_horizon.html 4160
mdp_LP.html 3245
mdp_policy_iteration.html 4940
mdp_policy_iteration_modified.html 4966
mdp_Q_learning.html 4185
mdp_relative_value_iteration.html 7682
mdp_span.html 2082
mdp_value_iteration.html 6568
mdp_value_iterationGS.html 8543
mdp_value_iteration_bound_iter.html 3580
mdp_verbose_silent.html 2446
meandiscrepancy.jpg 16285
QuickStart.pdf 309982
mdp_bellman_operator.m 3293
mdp_check.m 4043
mdp_check_square_stochastic.m 2266
mdp_computePpolicyPRpolicy.m 2924
mdp_computePR.m 2887
mdp_eval_policy_iterative.m 5498
mdp_eval_policy_matrix.m 3319
mdp_eval_policy_optimality.m 3929
mdp_eval_policy_TD_0.m 5405
mdp_example_forest.m 4734
mdp_example_rand.m 3842
mdp_finite_horizon.m 4092
mdp_LP.m 3844
mdp_policy_iteration.m 5245
mdp_policy_iteration_modified.m 5559
mdp_Q_learning.m 5399
mdp_relative_value_iteration.m 4876
mdp_silent.m 1736
mdp_span.m 1707
mdp_value_iteration.m 6361
mdp_value_iterationGS.m 7058
mdp_value_iteration_bound_iter.m 4768
mdp_verbose.m 1755
README 3582