Natural Language Processing with Attention Models

Week 1 - Neural Machine Translation

• Lab: Stack Semantics

• Lab: BLEU Score

• Programming Assignment: NMT with Attention

Week 2 - Text Summarization

• Lab: Attention

• Lab: The Transformer Decoder

• Programming Assignment: Transformer Summarizer

Week 3 - Question Answering

• Lab: SentencePiece and BPE

• Lab: BERT Loss

• Lab: T5

• Programming Assignment: Question Answering

Week 4 - Chatbot

• Lab: Reformer LSH

• Lab: Revnet

• Programming Assignment: Chatbot