===== Lectures Syllabus =====

^ Date ^ Lecture ^ Teacher ^ Materials ^ Notes / Reading ^
| 17.02.2021 ^ 1. Introduction to Neural Networks | BF | {{:courses:bev033dle:dl-neurons-nets.pdf| slides}} \\ [[https://bbb04.felk.cvut.cz//playback/presentation/2.0/playback.html?meetingId=133ca87f5968e96c1747ebab7e9795d965826166-1613555701169|record]]|  [[https://towardsdatascience.com/mcculloch-pitts-model-5fdf65ac5dd1| McCulloch-Pitts Neuron ]] |
| 24.02.2021 ^ 2. The Power of Neural Networks | BF | {{:courses:bev033dle:dl-losses-gen-bounds.pdf| slides}} \\ [[https://bbb04.felk.cvut.cz//playback/presentation/2.0/playback.html?meetingId=86b56196a40b8405f12d20725bdd5b957a19df6f-1614351496524|record]] | | 
| 03.03.2021 ^ 3. Backpropagation | AS | {{ :courses:bev033dle:backprop2.pdf | slides}} \\ [[https://bbb04.felk.cvut.cz//playback/presentation/2.0/playback.html?meetingId=19fb6336c1ea28e8b23579a5da43467ccd3c7456-1614765001804| record]] | |
| 10.03.2021 ^ 4. Stochastic Gradient Descent (SGD) | AS | {{ :courses:bev033dle:sgd.pdf | slides}} \\ [[https://bbb04.felk.cvut.cz//playback/presentation/2.0/playback.html?meetingId=95da80d35e4b324d574b7b37fea51a343e292a82-1615369803195|record]] | |
| 17.03.2021 ^ 5. Convolutional Neural Networks | AS | {{ :courses:bev033dle:cnn1.pdf | slides}} \\ [[https://bbb04.felk.cvut.cz//playback/presentation/2.0/playback.html?meetingId=0f588dbb7fa1312d9ba0368e32d36767e904d065-1615974601643 | record ]]  | [[ https://arxiv.org/abs/1603.07285 | A guide to convolution arithmetic for deep learning]]  |
| 24.03.2021 ^ 6. Data Augmentation, Weight Initialization, Batch Normalization | BF | {{ :courses:bev033dle:dl-init-bn-augm.pdf | slides}} \\ [[https://bbb04.felk.cvut.cz//playback/presentation/2.0/playback.html?meetingId=77e1f751eeb553cb55dbbb97920890e08f8a8a62-1616579401111 | record]] | |
| 31.03.2021 ^ 7. Regularization Methods for NNs | AS | {{ :courses:bev033dle:regularizers.pdf | slides}} \\ [[https://bbb04.felk.cvut.cz//playback/presentation/2.0/playback.html?meetingId=0228d890d81543eef6a43c5f7d75dbe389402275-1617180601922| record ]] | |
| 07.04.2021 ^ 8. Adaptive SGD Methods | AS | {{ :courses:bev033dle:adaptive3.pdf | slides}} \\ [[https://bbb04.felk.cvut.cz//playback/presentation/2.0/playback.html?meetingId=6d2680ca064bc6c9ae5b08789e2fdc26c58c41b9-1617785401919| record]] | |
| 14.04.2021 ^ 9. Adversarial Patterns. Robust Learning Approaches | BF | {{ :courses:bev033dle:adversarial.pdf | slides}} \\ [[https://bbb04.felk.cvut.cz//playback/presentation/2.0/playback.html?meetingId=6c5c9839789b6a71d1e103a3213e18e76bff69c2-1618390501363 | record]] | |
| 21.04.2021 ^ 10.  Learning Representations, Stochastic EM | AS | {{ :courses:bev033dle:representations-em.pdf | slides}} \\ [[https://bbb04.felk.cvut.cz//playback/presentation/2.0/playback.html?meetingId=25a5c0db4f3c1b027af1873324a6137af11be861-1618995001929| record]] | |
| 28.04.2021 ^ 11. Variational Autoencoders | BF | {{ :courses:bev033dle:vae.pdf | slides}} \\ [[https://bbb04.felk.cvut.cz//playback/presentation/2.0/playback.html?meetingId=4be0bffcc4dc41aa8cc370aa2c18ecda33c11298-1619600102148 | record]]| [[https://arxiv.org/abs/1606.05908| VAE tutorial]]|
| 05.05.2021 ^ 12. <fc steelblue> Guest lecture:</fc> Deep Metric Learning | [[ http://cmp.felk.cvut.cz/~toliageo/ | Giorgos Tolias]] | {{ :courses:bev033dle:metric-learning.pdf | slides}} \\ [[https://bbb04.felk.cvut.cz//playback/presentation/2.0/playback.html?meetingId=5a5e0142d4cf89df0daba1ac72ce87588696b2ca-1620204601932| record]] | |
| 12.05.2021 | --- Rector's day --- |  | | |
| 19.05.2021 ^ 13. Recurrent Neural Networks. Recurrent Back-Propagation | BF | {{ :courses:bev033dle:recurrent.pdf | slides}}| |