====== xp36vpd -- Selected parts of data mining ======

**Data mining** aims at revealing non-trivial, hidden and ultimately applicable knowledge in large data. This course focuses on two key data mining issues: data size and their heterogeneity. When dealing with large data, it is important to resolve both the technical issues such as distributed computing or hashing and general algorithmic complexity. In this part, the course will be motivated mainly by case studies on web and social network mining. The second part will discuss approaches that merge heterogeneous prior knowledge with measured data. Bioinformatics will make the main application field here. It is assumed that students have completed at least some of the master courses on Machine Learning and Data Analysis (B4M36SAN, B4M46SMU, BE4M33SSU).

The course will take a form of **reading and discussion group**. Each student gives two 1 hour lectures, followed by a 30 min discussion. One of the lectures shall be DM general (MMDS book chapters, recent tutorials at major ML/DM conferences, etc.), the second one can present your research (if DM related) or a DM topic that is closely related to your research or research interests. Each student is supposed to read a review paper recommended for the topic before presentations of the other students.

Go beyond the literature, provide own insight, offer own illustrative examples, etc.

The students who do not present are supposed to **read recommended reading** and **prepare a couple of questions** before the class. The questions will be discussed during or after the talk.

===== Fall 2020 =====

^  L  ^  Date  ^  Presents  ^  Contents  ^  Reading  ^  Talk, other links ^
|  1  |  Oct 9  |  JK, FZ  | Course overview, introduction, research interests.  | | {{ :courses:xp36vpd:vpd_intro.pdf | Course overview}}|
|  2  |  Oct 23  |  Petr Lorenc  | Few-shot learning | [[https://www.borealisai.com/en/blog/tutorial-2-few-shot-learning-and-meta-learning-i/|few-shot tut]] | {{ :courses:xp36vpd:few-shot_learning.pdf |Talk}} |
|  3  |  Oct 30  |  Martin Smolík  | Automated evaluation when learning complex outputs | [[https://towardsdatascience.com/evaluating-text-output-in-nlp-bleu-at-your-own-risk-e8609665a213|EvalBLEU]] | {{ :courses:xp36vpd:vpd_autevalcomplex.pdf |Talk}} |
|  4  |  Nov 6   |  Marek Dědič  | Learning on graph-structured data | [[https://towardsdatascience.com/a-gentle-introduction-to-graph-neural-network-basics-deepwalk-and-graphsage-db5d540d50b3|GNNIntro]] | {{ :courses:xp36vpd:xp36vpd-general-presentation.pdf |Talk}}, {{ :courses:xp36vpd:gcn_demo.pdf |Demo_pdf}}, {{ :courses:xp36vpd:gcn_demo.zip |Demo_zip}} |
|  5  |  Nov 13  |  Petr Cezner  | Generative Adversarial Networks | [[https://dl.acm.org/doi/10.5555/2969033.2969125|GANs]] | {{ :courses:xp36vpd:ceznepet-gan-20201113.pdf |Talk}} |
|  6  |  Nov 20  |  Vojtěch Jindra  | Attention is all you need | [[https://lilianweng.github.io/lil-log/2018/06/24/attention-attention.html|Attention]] | {{ :courses:xp36vpd:attention_vj.pdf |Talk}} |
|  7  |  Nov 27  |  Petr Lorenc  | Sentence embedding in NLP | [[https://www.analyticsvidhya.com/blog/2020/08/top-4-sentence-embedding-techniques-using-python/|Sentence Embedding]] | {{ :courses:xp36vpd:embeddings.pdf |Talk}} |
|  8  |  Dec 4   |  Martin Smolík  | Variational autoencoders and the math behind them | [[https://towardsdatascience.com/an-introduction-to-variational-auto-encoders-vaes-803ddfb623df|VAEs]] | {{ :courses:xp36vpd:vae_presentation.pdf |Talk}} |
|  9  |  Dec 11 |  Marek Dědič  | Multi-instance learning and its use for clustering | [[https://www.sciencedirect.com/science/article/pii/S0004370213000581|MIL (sections 1-6)]] |  {{ :courses:xp36vpd:xp36vpd-mil-presentation_1_.pdf |Talk}}, {{ :courses:xp36vpd:mil_demo.pdf |Demo_pdf}}, {{ :courses:xp36vpd:mil_demo.zip |Demo_zip}} |
|  10  |  Dec 18  |  Petr Cezner  | Gaussian processes | [[https://katbailey.github.io/post/gaussian-processes-for-dummies/|GPs]] | {{ :courses:xp36vpd:gaussian_processes.pdf |Talk}} |
|  11  |  Jan 8   |  Vojtěch Jindra  | Multi-instance learning and learning to cluster for clustering newspapers’ texts  |  [[https://arxiv.org/pdf/1711.10125.pdf | Learning2cluster]] | {{ :courses:xp36vpd:mil_l2c.pdf |Talk}} | 
|  13  |  Jan 8   |  JK, FZ  | **exam**  | | | 

===== References =====
  * Recent papers: [[https://distill.pub/|Distill papers]], [[https://arxiv.org/pdf/1606.04838.pdf|Optimization Methods for Large-Scale Machine Learning]], [[https://arxiv.org/pdf/1701.07875.pdf%20http://arxiv.org/abs/1701.07875.pdf|Wasserstein GAN]], [[https://dl.acm.org/ft_gateway.cfm?ftid=1775849&id=2939785|XGBoost: A Scalable Tree Boosting System]],[[https://arxiv.org/pdf/1702.08835.pdf|Deep Forest]], [[https://arxiv.org/pdf/1611.09347.pdf|Quantum Machine Learning]],
  * Rajaraman, A., Leskovec, J., Ullman, J. D.: [[http://www.mmds.org/|Mining of Massive Datasets]], Cambridge University Press, 2011.
  * [[http://bigdata-madesimple.com/27-free-data-mining-books/|Free Data mining Books]]
  * Recent tutorials, major ML/DM conferences: [[https://icml.cc/virtual/2020/events/Tutorial|ICML 2020]], [[https://icml.cc/Conferences/2019/ScheduleMultitrack?session=&event_type=Tutorial&day=|ICML 2019]], [[https://www.kdd.org/kdd2020/tutorials/lecture-tutorials|KDD 2020]],[[https://www.kdd.org/kdd2019/hands-on-tutorials|KDD 2019]], [[https://ecmlpkdd2020.net/programme/workshops/|ECML/PKDD 2020]], [[https://ecmlpkdd2019.org/programme/workshops/|ECML/PKDD 2019]], [[https://nips.cc/Conferences/2019/Schedule?type=Tutorial|NeurIPS 2019]], [[https://nips.cc/Conferences/2018/Schedule?type=Workshop|NIPS 2018]]
  * Review papers: [[http://www.cs.uvm.edu/~icdm/10Problems/10Problems-06.pdf|Yang, Wu: 10 CHALLENGING PROBLEMS IN DATA MINING RESEARCH]], [[http://www.realtechsupport.org/UB/CM/algorithms/Wu_10Algorithms_2008.pdf| Wu et al.: Top 10 algorithms in data mining]]
  * External seminars: [[http://ai.ms.mff.cuni.cz/~sui/|ML seminars at MFF]], [[http://praguecomputerscience.cz/|PIS]], [[ http://www.mlmu.cz/program/|Machine Learning Meetups]], [[https://keg.vse.cz/seminars.php|FIS KEG]].

===== Links =====

  * Lecturers: [[http://ida.felk.cvut.cz/klema/|Jiří Kléma]], [[http://ida.felk.cvut.cz/zelezny/|Filip Železný]]
  * [[https://www.fel.cvut.cz/cz/education/rozvrhy-ng.B201/public/html/predmety/29/68/p2968906.html|Class schedule]], meetings every Friday at 10:30 in MS Teams. NOT as in the official schedule!
  * [[https://www.fel.cvut.cz/cz/education/bk/predmety/29/68/p2968906|Course syllabus]].

===== Evaluation, requirements =====

  * every student must give his talks (the principle requirement in this type of course),
  * attendance and active discussion at presentations of other students,
  * pass the exam, i.e., prove the knowledge of basic concepts presented during the course.