CSE 562/662 - Natural Language Processing - Lecture 5

• Tentative outline:
• Smoothing techniques
• Katz Backoff, Deleted Interpolation, Absolute Discounting, Witten-Bell, Kneser-Ney estimation
• Unified view
• Backoff versus mixture
• Automaton structure
• Log linear models
• Cross-entropy and perplexity
• Composition with dictionaries
• Lecture slides link (when available):