====== Lectures ====== Lectures are delivered by [[mailto:petr.posik@cvut.cz|Petr Pošík]] or [[http://cmp.felk.cvut.cz/~svoboda|Tomas Svoboda (TS)]]. The course starts in **regular contact teaching regime**, but might change to [[courses:be5b33kui:distance_teaching|distance teaching]] if needed. We strongly suggest to attend the lectures personally. But we plan to make the lectures hybrid, such that you can take part also online. [[http://bigbluebutton.org|BigBlueButton]] will be used to deliver the lectures and for discussions. You will find the link to the course room in [[https://cw.felk.cvut.cz/brute/|BRUTE]], on Course => Conference rooms. BRUTE will also contain the lecture recordings in several formats: * Internal viewer - full recording, including slides or shared screen, video stream (blackboard), and chat. Please note the BBB player may not work in Safari properly, use another browser. Video stream (blackboard) and the slide screen can be interchanged. * MP4 - video containing only slides/shared screen. No blackboard recording. * PDF - pdf with all drawings made during the on-line session into the slides. You can also watch the MP4 recordings from the last year distance teaching at the [[https://youtube.com/playlist?list=PLhGZ28DZufNoCmaLlURGOwN2vUo2ARcZb|BE5B33KUI YouTube]] channel. PDF of the slides will be posted on this page. Preliminary version (e.g., last year's) before the lecture. Latest version, including teacher's notes shortly after the lecture. If you spot mistakes in the slides, please report them. Important corrections may be rewarded with bonus points. Active participation in lectures is welcomed and encouraged. [[courses:be5b33kui:literature|Books, on-line resources, specialization courses]] will be referenced throughout the lectures - their list is typically at the last slide. ===== Lecture plan ===== ^ Date ^ Week ^ Content ^ Alternative lecture video from [[https://inst.eecs.berkeley.edu/~cs188/fa18/|AI@Berkeley]] ^ | 14.02.2022 [[https://bbb04.felk.cvut.cz//playback/presentation/2.0/playback.html?meetingId=2828533d9d0b300486c0184441448bb2114c7691-1644829201212|BBB recording]] | 1 | Rules of the game (grading, assignments, etc.). Cybernetics and AI - motivation. Course overview. Is every problem solvable? N-puzzle. {{ :courses:be5b33kui:lectures:01_intro.pdf |}} | | | 21.02.2022 [[https://bbb04.felk.cvut.cz/playback/presentation/2.3/a6eee777c2d41a842e19d83b5f7628a10b67e545-1645436702107?meetingId=a6eee777c2d41a842e19d83b5f7628a10b67e545-1645436702107|BBB recording]] | 2 | Solving problems by search. Trees and graphs. Completeness, Optimality, Complexity. DFS, BFS. {{ :courses:be5b33kui:lectures:02_search.pdf |}}, {{ :courses:be5b33kui:lectures:02_search_handout_notes.pdf |}} | [[https://www.youtube.com/watch?v=-Xx0QSFYfIQ&list=PLsOUugYMBBJENfZ3XAToMsg44W7LeUVhF&index=2|Uninformed search]] | | 28.01.2022 [[https://bbb04.felk.cvut.cz//playback/presentation/2.0/playback.html?meetingId=39b767df76edaeededf54efa4960e5557670df71-1646041501706|BBB recording]]| 3 | Solving problems by search. How to avoid looping forever and how to go faster to the goal. Informed search. Heuristics. A*. {{ :courses:be5b33kui:lectures:03_search.pdf |}} {{ :courses:be5b33kui:lectures:03_search_live_withnotes.pdf |}}| [[https://www.youtube.com/watch?v=Mlwrx7hbKPs&list=PLsOUugYMBBJENfZ3XAToMsg44W7LeUVhF&index=3|Informed search]] | | 07.03.2022 Lecture not recorded. Use [[https://www.youtube.com/watch?v=849u9bW4Y_I&list=PLhGZ28DZufNoCmaLlURGOwN2vUo2ARcZb&index=4&t=5s|BBB recording]] from previous year. | 4 | Two player-games. Adversarial search - Search when playing against a (rational) opponent. {{ :courses:be5b33kui:lectures:04_adversarial.pdf |}} {{ :courses:be5b33kui:lectures:04_adversarial_live_withnotes.pdf |}}. | [[https://www.youtube.com/watch?v=v6RgZBjc8og&list=PLsOUugYMBBJENfZ3XAToMsg44W7LeUVhF&index=6|Adversarial search]] | | 14.03.2022 [[https://bbb04.felk.cvut.cz//playback/presentation/2.0/playback.html?meetingId=c9cb2065251de67d2e96879cd7507ae76ee066ff-1647251101921|BBB recording]] | 5 | Games with random elements, multi-player games. Expectimax. Utilities. {{ :courses:be5b33kui:lectures:05_expectimax.pdf |}} {{ :courses:be5b33kui:lectures:05_expectimax_live_withnotes.pdf |}} | [[https://www.youtube.com/watch?v=n3A29GEzC6g&list=PLsOUugYMBBJENfZ3XAToMsg44W7LeUVhF&index=7|Uncertainty and utilities]] | | 21.03.2022 [[https://bbb04.felk.cvut.cz//playback/presentation/2.0/playback.html?meetingId=e94f0dbbc221b88fc875c10b4b4e1e173e13298d-1647855902043|BBB recording]] | 6 | Decision-making under uncertainty I. Route to goal when action outcome is probabilistic. Value iteration. {{ :courses:be5b33kui:lectures:06_mdp.pdf |}} {{ :courses:be5b33kui:lectures:06_mdp_live_withnotes.pdf |}} | [[https://www.youtube.com/watch?v=4LW3H_Jinr4&list=PLsOUugYMBBJENfZ3XAToMsg44W7LeUVhF&index=8|Markov Decision Processes]] | | 28.03.2022 [[https://bbb04.felk.cvut.cz//playback/presentation/2.0/playback.html?meetingId=8f9579e46e38650b398d3cfc272b3f190a64d7ce-1648457101347|BBB recording]] | 7 | Decision-making under uncertainty II. Policy iteration. {{ :courses:be5b33kui:lectures:07_mdp.pdf |}} {{ :courses:be5b33kui:lectures:07_mdp_live_withnotes.pdf |}} | [[https://www.youtube.com/watch?v=ZToWj64rxvQ&list=PLsOUugYMBBJENfZ3XAToMsg44W7LeUVhF&index=9|Markov Decision Processes II]] | | 04.04.2022 [[https://bbb04.felk.cvut.cz//playback/presentation/2.0/playback.html?meetingId=9eb77e0b9b0a71df9b42d67137f014beeab7d83a-1649061901141|BBB recording]] | 8 | Reinforcement learning I. What if nothing is known about the probability of action outcomes and we have to learn from final success or failure? {{ :courses:be5b33kui:lectures:08_rl.pdf |}} {{ :courses:be5b33kui:lectures:08_rl_live_withnotes.pdf |}} | [[https://www.youtube.com/watch?v=TiXS7vROBEg&list=PLsOUugYMBBJENfZ3XAToMsg44W7LeUVhF&index=10|Reinforcement learning]] | | 11.04.2022 [[https://bbb04.felk.cvut.cz//playback/presentation/2.0/playback.html?meetingId=ea819f2a2015c16ef7c9b6de5d3b26b3f3131e20-1649667361965|BBB recording]] | 9 | Reinforcement learning II. Exploration vs. exploitation. {{ :courses:be5b33kui:lectures:09_rl.pdf |}} {{ :courses:be5b33kui:lectures:09_rl_live_withnotes.pdf |}} | [[https://www.youtube.com/watch?v=XafrqwHfBKE&list=PLsOUugYMBBJENfZ3XAToMsg44W7LeUVhF&index=11|Reinforcement learning II]] | | 18.04.2022 | | Holiday - Easter Monday | | 25.04.2022 | 10 | **Mid-term exam** from topics covered up to now. Inspiration: quizzes. | | 02.05.2022 [[https://bbb04.felk.cvut.cz/playback/presentation/2.3/9985a3a5d07a9271dcc586a5702569a155aea960-1651481101904?meetingId=9985a3a5d07a9271dcc586a5702569a155aea960-1651481101904|BBB recording]] | 11 | Basic concepts of probability. Bayesian classification and decisions. {{ :courses:be5b33kui:lectures:10_bayes.pdf |}} {{ :courses:be5b33kui:lectures:10_bayes_live_withnotes.pdf |}}| [[https://www.youtube.com/watch?v=sMNbLXsvRig&list=PLsOUugYMBBJENfZ3XAToMsg44W7LeUVhF&index=12|Probability]] | | 09.05.2022 [[https://bbb04.felk.cvut.cz//playback/presentation/2.0/playback.html?meetingId=ec3fd5761e30f8c2982384310e496078d3b6a42b-1652085901977|BBB recording]] | 12 | Naive Bayesian classification, Laplace smoothing, Precision, Recall and ROC curve. {{ :courses:be5b33kui:lectures:11_recog_a.pdf |}} {{ :courses:be5b33kui:lectures:11_recog_a_live_withnotes.pdf |}}| [[https://www.youtube.com/watch?v=1nOb0vwWkAE&list=PLsOUugYMBBJENfZ3XAToMsg44W7LeUVhF&index=20|Naive Bayes]], [[https://www.coursera.org/lecture/python-machine-learning/precision-recall-and-roc-curves-8v6DL| ROC curve]], [[https://youtu.be/W5meQnGACGo |video by Andrew Ng]] | | 16.05.2022 [[https://bbb04.felk.cvut.cz//playback/presentation/2.0/playback.html?meetingId=65caa97bda7698b21fd32aa4916e935df87a3792-1652690701985|BBB recording]] | 13 | Linear classifiers, perceptron. {{ :courses:be5b33kui:lectures:11_recog_b.pdf |}} {{ :courses:be5b33kui:lectures:11_recog_b_live_withnotes.pdf |}}| [[https://www.youtube.com/watch?v=UNr9gHyOnWA&list=PLsOUugYMBBJENfZ3XAToMsg44W7LeUVhF&index=21|Perceptrons and Logistic Regression]] - the perceptron part, or Nearest neighbor (k-nn) classification, watch [[https://www.youtube.com/watch?v=H9DUTH9lCfg|Kernels and Clustering]] - the nearest neighbors part |