LLM Inference Internals: KV Cache, PagedAttention, and Continuous Batching

Deep dive into making LLMs fast. Understand the KV cache, memory management, and scaling inference. This comprehensive curriculum is designed to give you hands-on experience with LLM Inference Internals: KV Cache, PagedAttention, and Continuous Batching. This AI Infrastructure curriculum is designed to give you hands-on experience and deep conceptual understanding. Across 7 intensive modules, you'll tackle real-world challenges and build practical projects that reinforce your learning. By the end of this journey, you'll have the skills and proof of work to demonstrate your expertise.