EECS 224 lecture notes (Spring 2025)

As EECS 224 is a new class, the lecture notes are being constructed on the fly. New content will be added as the quarter progresses.

---

Table of contents

• Overview of LLMs
• Tokenization
• Query Embedding
• Token Embeddings
• Positional Embedding
• Value Embedding
• Attention
• Multi-Head Attention
• Complexity Analysis
• Decoding
• Feed-Forward
• Instruction Tuning
• Output Distribution
• Pretraining
• Stacking Layers