Course
LLMs on Kubernetes hands-on
Running private AI yourself
Tick off what you've done and continue on any device. Sign up for free
- Foreword
- Day 0: The Training Ground approx. 45 min
- Day 1: kind Cluster for AI Workloads approx. 60 min
- Day 2: First Model in a Pod approx. 75 min
- Day 3: vLLM Basics – Engine, Sizing, Manifest approx. 75 min
- Day 4: LiteLLM as a Gateway – Aliases, Keys, Budgets approx. 90 min
- Day 5: Chat with Open WebUI in kind approx. 75 min
- Day 6: Preparing Proxmox approx. 90 min
- Day 7: Six VMs with OpenTofu approx. 75 min
- Day 8: RKE2 HA with Ansible approx. 120 min
- Day 9: Platform Foundation approx. 120 min
- Day 10: GPUs in Kubernetes approx. 150 min
- Day 11: vLLM on the GPU approx. 150 min
- Day 12: LiteLLM in Production approx. 150 min
- Day 13: LLM Chat for the Team – Open WebUI, Keycloak and RAG with Qdrant approx. 180 min
- Day 14: Code LLM – Autocomplete and Chat in VS Code approx. 150 min
- Day 15: Operations and Competition approx. 300 min
- Appendix A: Cheat Sheet
- Appendix B: Final Exam 180 min hands-on + 30 min questions