NLP, Foundations to Advanced

Программа курса

1. Text Processing — Tokenization, Stemming, Lemmatization
2. Bag of Words, TF-IDF, and Text Representation
3. Word Embeddings — Word2Vec from Scratch
4. GloVe, FastText, and Subword Embeddings
5. Sentiment Analysis
6. Named Entity Recognition
7. POS Tagging and Syntactic Parsing
8. CNNs and RNNs for Text
9. Sequence-to-Sequence Models
10. Attention Mechanism — The Breakthrough
11. Machine Translation
12. Text Summarization
13. Question Answering Systems
14. Information Retrieval and Search
15. Topic Modeling — LDA and BERTopic
16. Text Generation Before Transformers — N-gram Language Models
17. Chatbots — Rule-Based to Neural to LLM Agents
18. Multilingual NLP
19. Subword Tokenization — BPE, WordPiece, Unigram, SentencePiece
20. Structured Outputs & Constrained Decoding
21. Natural Language Inference — Textual Entailment
22. Embedding Models — The 2026 Deep Dive
23. Chunking Strategies for RAG
24. Coreference Resolution
25. Entity Linking & Disambiguation
26. Relation Extraction & Knowledge Graph Construction
27. LLM Evaluation — RAGAS, DeepEval, G-Eval
28. Long-Context Evaluation — NIAH, RULER, LongBench, MRCR
29. Dialogue State Tracking
30. Итоговое задание