Neural NLP course for CL-2022
Wednesdays, 14:40 msk
zoom link: https://uni-hamburg.zoom.us/j/68413791189?pwd=dFMzQVdrV0xQbC91ZVp0T2d3VVlUQT09
Background quiz: https://forms.gle/JFVf5NMmxQ6hxVGXA
Project & RG tables: https://docs.google.com/spreadsheets/d/1xxeQzSzo50DzOI6LcdPkECUcDTOW0JpzhIf6uWcnUBA/edit?usp=sharing
tg link: https://t.me/+jEhCROivh_Y5OTEy
Grading
https://docs.google.com/spreadsheets/d/1uGmHJxa7sXD5zpzj_tAyiFn_x3JU_rYPEjPP_Eb9-uU/edit?usp=sharing
HW-1 (Deadline: November 6, 23:59)
Task description: https://drive.google.com/file/d/1UiGlQxNk3EMMaIyfFhJOyhMF_6IG6o61/view?usp=sharing
Google form link to submit: https://forms.gle/4VTUgA1ro87opfew6
HW-2 (Deadline: December 21, 23:59)
Task description: https://github.com/lilaspourpre/nnlp-cl-2022/blob/main/HW-2.md
Google form link to submit: https://forms.gle/q3TahYmPbNfB6gGr9
Timetable
| Date | Type | Topic | Reading club | Slides/Colab link | Video | Additional links | Session recording | |
|---|---|---|---|---|---|---|---|---|
| Sep 7 | lecture | Intro | - | slides | - | - | https://youtu.be/kHt6CAyvkxU | |
| Sep 14 | seminar | Preprocessing | - | regexp, preprocessing, lemmatizers comparison | - | - | https://youtu.be/cGuymVVUje4 | |
| Sep 21 | seminar | ML recap | - | colab | https://www.youtube.com/watch?v=SZkrxWhI5qM | https://www.youtube.com/playlist?list=PLJOzdkh8T5krxc4HsHbB8g8f0hu7973fK | https://youtu.be/JyY2nvzS3ws | |
| Sep 28 | lecture | Feed-Forward Neural Networks | - | FFNN slides, Lena Voita's materials, NN-Intro (slides), NN-backprop | part-1, part-2 | What is a Neural Network?, NN-Intro, NN-backprop, MLP intro, word embeddings, MLP forward, MLP backward | https://youtu.be/b5Kha36QYNs | |
| Oct 19 | lecture + seminar | Feed-Forward Neural Networks | Success with Style: Using Writing Style to Predict the Success of Novels | FFNN_intro, FFNN (advanced), torch intro, mlp torch | torch tensors, torch dataset, torch linear model | https://youtu.be/vaJIM59FeOQ | ||
| Nov 2 | lecture + seminar | Feed-Forward Neural Networks | - | slides | https://youtu.be/sUsWE1M-X7c | |||
| Nov 9 | lecture | Convolutional Neural Networks | Text Style Transfer: A Review and Experimental Evaluation (Hu et al., 2022) | slides | https://youtu.be/V7YNOAg6Jds | |||
| Nov 10 | seminar | Convolutional Neural Networks | - | colab | https://youtu.be/hUBixuQ0-xc | |||
| Nov 16 | lecture | Recurrent Neural Networks | https://wandb.ai/site | slides | https://youtu.be/5ptSNvOhA5Q | |||
| Nov 23 | seminar | Recurrent Neural Networks | - | colab | https://youtu.be/7IgTk-liFVA | |||
| Nov 30 | lecture | Sequence2sequnece & Attention | - | slides | https://youtu.be/V4Z23nZwqD4 | |||
| Dec 2 | seminar | Sequence2sequnece & Attention | - | colab | https://youtu.be/JFID5zq3GHk | |||
| Dec 7 | lecture & seminar | Attention | - | slides | https://youtu.be/TR_9R-mMPTg | |||
| Dec 9 | seminar | Attention | - | colab | https://youtu.be/B5xSyHsi8Kc | |||
| Dec 14 | lecture | Transformers | Полина Машковцева, Полина Черноморченко, Таня Перевощиковаи Саша Шахнова | slides, attention slides | a very nice video with explanation | https://youtu.be/nIRicydRXV8 | ||
| Dec 16 | seminar | Transformers | - | colab | https://youtu.be/0JSN4BYQ_is |
Projects
Project 1, Project 2, Project 3, Project 4, Project 5
Other examples can be found on Telegram chat.
NLP tasks
