Preview: not published yet
This tutorial is not available to read yet. The chapters and figures on this page are sample content. Request a tutorial
What's inside
- Chapter 1: From recurrence to attention
- Chapter 2: Scaled dot-product attention
- Chapter 3: Multi-head attention
- Chapter 4: Positional encoding
- Chapter 5: Feed-forward blocks and residuals
- Chapter 6: Layer normalisation
- Chapter 7: Training at scale
- Chapter 8: Inference and the KV cache
- Chapter 9: Efficient attention variants
- Chapter 10: Failure modes
- Chapter 11: Benchmarks and what they miss
- Chapter 12: Migration paths