Quick links: [[https://intranet.fel.cvut.cz/cz/education/rozvrhy-ng.B232/public/html/predmety/61/70/p6170206.html | Schedule]] | [[https://cw.felk.cvut.cz/forum/forum-1874.html|Forum]] | [[https://cw.felk.cvut.cz/brute/teacher/course/1595| BRUTE]] | [[https://cw.fel.cvut.cz/b232/courses/bev033dle/labs/start | Labs]] ===== Lectures Syllabus ===== ^ Date ^ Lecture ^ Teacher ^ Materials ^ Reading ^ | 21.02.2024 ^ 1. Introduction to Neural Networks | BF | {{:courses:bev033dle:dl-neurons-nets.pdf| slides }} | {{https://towardsdatascience.com/mcculloch-pitts-model-5fdf65ac5dd1 | McCulloch-Pitts Neuron}} | | 28.02.2024 ^ 2. The Power of Neural Networks | BF | {{:courses:bev033dle:dl-losses-gen-bounds.pdf| slides }}| | | 06.03.2024 ^ 3. Backpropagation | AS | {{ :courses:bev033dle:backprop.pdf | slides}}| [[https://implicit-layers-tutorial.org/ | Implicit Layers, Chapter 1]]| | 13.03.2024 ^ 4. Stochastic Gradient Descent (SGD) | AS | {{ :courses:bev033dle:sgd.pdf | slides }}| | | 20.03.2024 ^ 5. Convolutional Neural Networks | AS | {{ :courses:bev033dle:cnn2.pdf | slides }}| [[https://geometricdeeplearning.com/|Geometric Deep Learning]]| | 27.03.2024 ^ 6. Weight Initialization, Batch Normalization, Resnets, Transfer Learning | BF | {{ :courses:bev033dle:dl-init-bn-trsfl.pdf | slides }}| | | 03.04.2024 ^ 7. Regularization Methods for NNs | AS | {{ :courses:bev033dle:regularizers4.pdf | slides}} | Goodfellow Chapter 7| | 10.04.2024 ^ 8. Adaptive SGD Methods | AS | {{ :courses:bev033dle:adaptive4.pdf | slides}}| | | 17.04.2024 ^ 9. Adversarial Patterns. Robust Learning Approaches | BF | {{ :courses:bev033dle:adversarial.pdf | slides}}| | | 24.04.2024 ^ 10. Learning Representations I: Metric Learning, Word Vectors | AS | {{ :courses:bev033dle:rl-1-2024.pdf | slides}}| | | 01.05.2024 | --- Holiday --- | | | | | 08.05.2024 | --- Holiday, replacement day Thu 09.05.2024 --- | | | | | 09.05.2024 ^ 11. Learning Representations II: t-SNE, Unsupervised RL | AS | {{ :courses:bev033dle:svi-2024.pdf | slides}}| | | 15.05.2024 ^ 12. Learning Representations III: Variational Autoencoders | BF | {{ :courses:bev033dle:vae.pdf | slides}} | | | 22.05.2024 ^ 13. Recurrent Neural Networks, Transformer networks | BF | {{ :courses:bev033dle:recurrent.pdf | slides}}| | /* ^ Date ^ Lecture ^ Teacher ^ Materials ^ Notes / Reading ^ | 21.02.2024 ^ 1. Introduction to Neural Networks | BF | {{:courses:bev033dle:dl-neurons-nets.pdf| slides }} | | | 28.02.2024 ^ 2. The Power of Neural Networks | BF | {{:courses:bev033dle:dl-losses-gen-bounds.pdf| slides }} | | | 06.03.2024 ^ 3. Backpropagation | AS | {{ :courses:bev033dle:backprop.pdf | slides}} | | | 13.03.2024 ^ 4. Stochastic Gradient Descent (SGD) | AS | {{ :courses:bev033dle:sgd.pdf | slides}} | | | 20.03.2024 ^ 5. Convolutional Neural Networks | AS | {{ :courses:bev033dle:cnn1.pdf | slides}} | | | 27.03.2024 ^ 6. Weight Initialization, Batch Normalization, Resnets, Transfer Learning | BF | {{ :courses:bev033dle:dl-init-bn-augm.pdf | slides}} | | | 03.04.2024 ^ 7. Regularization Methods for NNs | AS | {{ :courses:bev033dle:regularizers3.pdf | slides}} | Goodfellow: 7.1-7.12| | 10.04.2024 ^ 8. Adaptive SGD Methods | AS | {{ :courses:bev033dle:adaptive3.pdf | slides }} | | | 17.04.2024 ^ 9. Adversarial Patterns. Robust Learning Approaches | BF | {{ :courses:bev033dle:adversarial.pdf | slides}} | | | 24.04.2024 ^ 10. Learning Representations I: Metric Learning, Word Vectors | AS | {{ :courses:bev033dle:rl-1-2023.pdf | slides}}| | | 01.05.2024 | --- Holiday --- | | | | | 08.05.2024 | --- Holiday, replacement day Thu 09.05.2024 --- | | | | | 09.05.2024 ^ 11. Learning Representations II: t-SNE, Unsupervised RL | AS | {{ :courses:bev033dle:svi-2023.pdf | slides}} | | | 15.05.2024 ^ 12. Learning Representations III: Variational Autoencoders | BF | {{ :courses:bev033dle:vae.pdf | slides}} | | | 22.05.2024 ^ 13. Recurrent Neural Networks, Transformer networks | BF | {{ :courses:bev033dle:recurrent.pdf | slides}} | | */