Skip to content
Hands-on IT IT Drills

Course

LLMs on Kubernetes hands-on

Running private AI yourself

Tick off what you've done and continue on any device. Sign up for free

  1. Foreword
  2. Day 0: The Training Ground approx. 45 min
  3. Day 1: kind Cluster for AI Workloads approx. 60 min
  4. Day 2: First Model in a Pod approx. 75 min
  5. Day 3: vLLM Basics – Engine, Sizing, Manifest approx. 75 min
  6. Day 4: LiteLLM as a Gateway – Aliases, Keys, Budgets approx. 90 min
  7. Day 5: Chat with Open WebUI in kind approx. 75 min
  8. Day 6: Preparing Proxmox approx. 90 min
  9. Day 7: Six VMs with OpenTofu approx. 75 min
  10. Day 8: RKE2 HA with Ansible approx. 120 min
  11. Day 9: Platform Foundation approx. 120 min
  12. Day 10: GPUs in Kubernetes approx. 150 min
  13. Day 11: vLLM on the GPU approx. 150 min
  14. Day 12: LiteLLM in Production approx. 150 min
  15. Day 13: LLM Chat for the Team – Open WebUI, Keycloak and RAG with Qdrant approx. 180 min
  16. Day 14: Code LLM – Autocomplete and Chat in VS Code approx. 150 min
  17. Day 15: Operations and Competition approx. 300 min
  18. Appendix A: Cheat Sheet
  19. Appendix B: Final Exam 180 min hands-on + 30 min questions