Language Modeling

---

Table of contents

• Introduction to Language Modeling
• LM Equations
• n-gram
• Smoothing and Discounting
• Interpolation and Back-off
• Perplexity
• n-gram Summary
• Appendix - n-gram Exercise
• RNN LM
• Perplexity and Cross Entropy
• Autoregressive and Teacher Forcing
• Wrap-up
• Self-supervised Learning

---