https://cw.fel.cvut.cz/b192/ 2026-04-19T10:13:24+0200 https://cw.fel.cvut.cz/b192/ https://cw.fel.cvut.cz/b192/lib/tpl/bulma-cw/images/favicon.ico text/html 2020-02-11T16:46:05+0200 Anonymous (anonymous@undisclosed.example.com) https://cw.fel.cvut.cz/b192/courses/smu/tutorials/tutorial1?rev=1581435965&do=diff SW tools This page summarizes installation and usage of several tools for machine learning and data mining. Python For tutorials and homeworks we will be using (among others) python and jupyter notebooks. For convenience, we use conda distribution of Python. Download miniconda from text/html 2020-02-11T16:46:05+0200 Anonymous (anonymous@undisclosed.example.com) https://cw.fel.cvut.cz/b192/courses/smu/tutorials/tutorial3?rev=1581435965&do=diff NumPy Cheat Sheet - useful for those new to numpy. Animals dataset for Python import numpy as np animals_interpretations = np.array([ [1, 1, 0, 0, 0, 1, 1, 0], [0, 0, 1, 0, 0, 1, 1, 1], [0, 0, 0, 0, 0, 1, 0, 0], [1, 0, 0, 0, 0, 1, 0, 0], [0, 0, 1, 0, 1, 0, 1, 0], [0, 0, 0, 0, 1, 1, 1, 0], [0, 0, 0, 1, 0, 1, 1, 0], [1, 0, 0, 1, 0, 1, 1, 0], [0, 1, 0, 0, 0, 1, 1, 0], [0, 1, 1, 0, 0, 1, 1, 0], [0, 0, 0, 0, 0, 1, 1, 1], [0, 0, 1, 0, 0, 1, 1, 0], [0, 0, 0, 0, 0, 1, 1, 0]… text/html 2020-03-02T19:56:55+0200 Anonymous (anonymous@undisclosed.example.com) https://cw.fel.cvut.cz/b192/courses/smu/tutorials/tutorial9?rev=1583175415&do=diff Tutorial 3 - reinforcement learning III. Problem 1 - Passive reinforcement learning Consider the following MDP. Assume that reward is in the form $r(s,a)$, i.e., $r: S \times A \mapsto \mathbb{R}$. Set $\gamma = \frac{1}{2}$. Suppose that you have seen the following sequence of states, actions, and rewards: $$ s_1, \mathrm{switch}, s_2, \mathrm{stay}, +1, s_2, \mathrm{stay}, +1, s_2, \mathrm{switch}, s_1, \mathrm{stay}, s_1, \mathrm{switch}, s_1, \mathrm{switch}, s_1, \mathrm{…