====== Lectures ====== Lectures are delivered by [[mailto:petr.posik@cvut.cz|Petr Pošík]] or [[http://cmp.felk.cvut.cz/~svoboda|Tomas Svoboda (TS)]]. We strongly suggest attending the lectures personally. The lectures will have a hybrid form, they will be streamed and recorded. [[http://bigbluebutton.org|BigBlueButton]] will be used to deliver the lectures. You will find the link to the course room in [[https://cw.felk.cvut.cz/brute/|BRUTE]], on Course => Conference rooms. BRUTE will also contain the lecture recordings in several formats: * Internal viewer - full recording, including slides or shared screen, video stream (blackboard), and chat. Please note the BBB player may not work in Safari properly, use another browser. Video stream (showing blackboard in the classroom or shared screen) and the slide screen can be interchanged. * MP4 - video containing only slides/shared screen. No blackboard recording. * PDF - pdf with all drawings made during the on-line session into the slides. You can also watch the MP4 recordings from a previous year distance teaching at the [[https://youtube.com/playlist?list=PLhGZ28DZufNoCmaLlURGOwN2vUo2ARcZb|BE5B33KUI YouTube]] channel. However, beware that the content of the course might have changed slightly since then. PDF of the slides will be posted on this page. Preliminary version (e.g., last year's) before the lecture. Latest version, including teacher's notes shortly after the lecture. If you spot mistakes in the slides, please report them. Important corrections may be rewarded with bonus points. Active participation in lectures is welcomed and encouraged. [[courses:be5b33kui:literature|Books, on-line resources, specialization courses]] will be referenced throughout the lectures - their list is typically at the last slide. ===== Lecture plan ===== ^ Date ^ Week ^ Content ^ Alternative lecture video from [[https://inst.eecs.berkeley.edu/~cs188/fa18/|AI@Berkeley]] ^ | 19.02.2024 [[https://bbb04.felk.cvut.cz//playback/presentation/2.0/playback.html?meetingId=8c6ed4d43a52235458d8267b7c61385006a23dbc-1708335901501|BBB rec.]] | 1 | Rules of the game (grading, assignments, etc.). Cybernetics and AI - very short intro. {{ :courses:be5b33kui:lectures:01_intro.pdf |}} Solving problems by search. Completeness, Optimality, Complexity. DFS, BFS. {{ :courses:be5b33kui:lectures:02_search.pdf |}}, {{ :courses:be5b33kui:lectures:02_search_live_withnotes.pdf |}}| [[https://www.youtube.com/watch?v=-Xx0QSFYfIQ&list=PLsOUugYMBBJENfZ3XAToMsg44W7LeUVhF&index=2|Uninformed search]] | | 26.02.2024 [[https://bbb04.felk.cvut.cz//playback/presentation/2.0/playback.html?meetingId=85bfb3735aa909a0d05a235cc335957892833d2d-1708940701181|BBB rec.]] | 2 | Solving problems by search. How to avoid looping forever and how to go faster to the goal. Informed search. Heuristics. A*. {{ :courses:be5b33kui:lectures:025_search.pdf |}}, {{ :courses:be5b33kui:lectures:025_search_live_withnotes.pdf |}}, {{ :courses:be5b33kui:lectures:025_search_handout_notes.pdf |}} | [[https://www.youtube.com/watch?v=Mlwrx7hbKPs&list=PLsOUugYMBBJENfZ3XAToMsg44W7LeUVhF&index=3|Informed search]] | | 04.03.2024 [[https://bbb04.felk.cvut.cz//playback/presentation/2.0/playback.html?meetingId=e275351678535d7ac430586c64e7d3e3a8df5db5-1709545501904|BBB rec.]] | 3 | Two player-games. Adversarial search - Search when playing against a (rational) opponent. {{ :courses:be5b33kui:lectures:04_adversarial.pdf |}} {{ :courses:be5b33kui:lectures:04_adversarial_live_withnotes.pdf |}} {{ :courses:be5b33kui:lectures:04_adversarial_handout_notes.pdf |}} | [[https://www.youtube.com/watch?v=v6RgZBjc8og&list=PLsOUugYMBBJENfZ3XAToMsg44W7LeUVhF&index=6|Adversarial search]] | | 11.03.2024 [[https://bbb04.felk.cvut.cz//playback/presentation/2.0/playback.html?meetingId=e29ec619fa138ca36e3ce2f9d1b0b631f80053e8-1710150301820|BBB rec.]] | 4 | Probability and statistics - the required minimum. {{ :courses:be5b33kui:lectures:045_probability.pdf |}} {{ :courses:be5b33kui:lectures:045_probability_handout_notes.pdf |}}| [[https://www.youtube.com/watch?v=sMNbLXsvRig&list=PLsOUugYMBBJENfZ3XAToMsg44W7LeUVhF&index=12|Probability]] | | 18.03.2024 [[https://bbb04.felk.cvut.cz//playback/presentation/2.0/playback.html?meetingId=d5a91dedd1c7be94e4158da6106e0da3b05d9cca-1710755101184|BBB rec.]] | 5 | Games with random elements, multi-player games. Expectimax. Utilities. {{ :courses:be5b33kui:lectures:05_expectimax.pdf |}} {{ :courses:be5b33kui:lectures:05_expectimax_handout_notes.pdf |}} | [[https://www.youtube.com/watch?v=n3A29GEzC6g&list=PLsOUugYMBBJENfZ3XAToMsg44W7LeUVhF&index=7|Uncertainty and utilities]] | | 25.03.2024 [[https://bbb04.felk.cvut.cz//playback/presentation/2.0/playback.html?meetingId=6830e3d2e8a3f851bdff7b77d0a8d326eef38157-1711359901803|BBB rec.]] | 6 | Decision-making under uncertainty I. Route to goal when action outcome is probabilistic. Value iteration. {{ :courses:be5b33kui:lectures:06_mdp.pdf |}} {{ :courses:be5b33kui:lectures:06_mdp_handout_notes.pdf |}} | [[https://www.youtube.com/watch?v=4LW3H_Jinr4&list=PLsOUugYMBBJENfZ3XAToMsg44W7LeUVhF&index=8|Markov Decision Processes]] | | 01.04.2024 | 7 | **Holiday - Easter Monday** | | | 08.04.2024 [[https://bbb04.felk.cvut.cz//playback/presentation/2.0/playback.html?meetingId=89e519cd43bc2f88151176726ca33888101e7d50-1712566621462|BBB rec.]] | 8 | Decision-making under uncertainty II. Policy iteration. {{ :courses:be5b33kui:lectures:07_mdp.pdf |}} {{ :courses:be5b33kui:lectures:07_mdp_handout_notes.pdf |}} | [[https://www.youtube.com/watch?v=ZToWj64rxvQ&list=PLsOUugYMBBJENfZ3XAToMsg44W7LeUVhF&index=9|Markov Decision Processes II]] | | 15.04.2024 [[https://bbb04.felk.cvut.cz//playback/presentation/2.0/playback.html?meetingId=8dc830694db4c8871326e4263a8fee0df420ef93-1713170701476|BBB rec.]] | 9 | Reinforcement learning I. What if nothing is known about the probability of action outcomes and we have to learn from final success or failure? {{ :courses:be5b33kui:lectures:08_rl.pdf |}} {{ :courses:be5b33kui:lectures:08_rl_handout_notes.pdf |}} | [[https://www.youtube.com/watch?v=TiXS7vROBEg&list=PLsOUugYMBBJENfZ3XAToMsg44W7LeUVhF&index=10|Reinforcement learning]] | | 22.04.2024 [[https://bbb04.felk.cvut.cz//playback/presentation/2.0/playback.html?meetingId=0a3305655bc17b32744590dab6d047619e6f52a5-1713775501365|BBB rec.]]| 10 | Reinforcement learning II. Exploration vs. exploitation. {{ :courses:be5b33kui:lectures:09_rl.pdf |}} {{ :courses:be5b33kui:lectures:09_rl_handout_notes.pdf |}} | [[https://www.youtube.com/watch?v=XafrqwHfBKE&list=PLsOUugYMBBJENfZ3XAToMsg44W7LeUVhF&index=11|Reinforcement learning II]] | | 29.04.2024 | 11 | **Mid-term exam** from topics covered up to now. Inspiration: quizzes. | | | 06.05.2024 [[https://bbb04.felk.cvut.cz//playback/presentation/2.0/playback.html?meetingId=478482fee99f236d8852dd6d503f5f14a6919d2e-1714985101437|BBB rec.]] | 12 | Bayesian classification and decisions. {{ :courses:be5b33kui:lectures:10_bayes.pdf |}} {{ :courses:be5b33kui:lectures:10_bayes_handout_notes.pdf |}} | | | 13.05.2024 | 13 | Learning from data I. Naive Bayes classifier. Nearest neighbors. Evaluating classifier performance. {{ :courses:be5b33kui:lectures:11_recog_a.pdf |}} {{ :courses:be5b33kui:lectures:11_recog_a_handout_notes.pdf |}} | [[https://www.youtube.com/watch?v=1nOb0vwWkAE&list=PLsOUugYMBBJENfZ3XAToMsg44W7LeUVhF&index=20|Naive Bayes]], [[https://www.coursera.org/lecture/python-machine-learning/precision-recall-and-roc-curves-8v6DL| ROC curve]], [[https://youtu.be/W5meQnGACGo |video by Andrew Ng]], [[https://www.youtube.com/watch?v=H9DUTH9lCfg|Kernels and Clustering]] - the nearest neighbors part | | 20.05.2024 | 14 | Learning from data II. Linear classifiers. {{ :courses:be5b33kui:lectures:11_recog_b.pdf |}} {{ :courses:be5b33kui:lectures:11_recog_b_handout_notes.pdf |}} | [[https://www.youtube.com/watch?v=UNr9gHyOnWA&list=PLsOUugYMBBJENfZ3XAToMsg44W7LeUVhF&index=21|Perceptrons and Logistic Regression]] - the logistic regression part |