Semestral task 3

The goal of the task is to implement the value iteration algorithm for Markov Decision Processes

Explanation of semestral task 3
Programming and testing framework: pymdptestbed-v1.1
Word template
LaTeX template

You should submit

A python file (*.py) with the required source code.
File surname.pdf with the report, which includes the following sections: Implementation, Experimental results, Discussion.
LaTeX sourced if LaTeX was used.

The report may be in Czech or in English, shall have the form of a scientific article, it should be concise, self-contained, showing everything the author wants to show.

Last year's version in Java (only as a backup in case there are some serious technical difficulties):