EulerFold
AI/ML

Running Local LLMs with llama.cpp and GGUF

4 weeks
0 Learners
Jul 23

Run large language models locally using GGUF and llama.cpp. Optimize inference speed and manage hardware constraints.

Share:

About this Course

Run large language models locally using GGUF and llama.cpp. Optimize inference speed and manage hardware constraints. This AI/ML curriculum is designed to give you hands-on experience and deep conceptual understanding. Across 4 intensive modules, you'll tackle real-world challenges and build practical projects that reinforce your learning. By the end of this journey, you'll have the skills and proof of work to demonstrate your expertise.

What you'll learn

Master the core concepts of introduction to local inference.
Gain hands-on experience with running models with llama.cpp.
Understand the architecture behind advanced inference techniques.
Implement production-grade optimization and deployment.

Prerequisites

intermediate Level

Requires basic familiarity with the tech stack.

  • Python scripting
  • Basic linear algebra & tensors

Ideal for

Anyone interested in AI/ML who wants to learn about Running Local LLMs with llama.cpp and GGUF.

AI/ML Engineers
W1

Introduction to Local Inference

Master the core concepts of introduction to local inference.

4 videos63m
3 readings
4 topics
1 homework
Learn

Topics

1.1
The Inference Bottleneck
21 minutes
1.2
Quantization Basics
9 minutes
1.3
The GGUF Format
8 minutes
1.4
Hardware Considerations
25 minutes
W2

Running Models with llama.cpp

Gain hands-on experience with running models with llama.cpp.

4 videos45m
3 readings
4 topics
1 homework
Learn
W3

Advanced Inference Techniques

Understand the architecture behind advanced inference techniques.

4 videos97m
3 readings
4 topics
1 homework
Learn
W4

Optimization and Deployment

Implement production-grade optimization and deployment.

4 videos57m
3 readings
4 topics
1 homework
Learn
01

Learn

Watch curated videos and read study resources

02

Practice

Practice what you learned

03

Build Projects

Build projects using your new gained knowledge

04

Submit & Verify

Submit your project and get verified by our system

Rate this course

0.0
0 reviews

Help the community find verified technical paths.

Community Insights

0

Join the discussion

Sign in to share your thoughts and technical insights.

Loading insights...