KubeAI, private Open AI on K8s: https://github.com/substratusai/kubeai

Tutorial with copy pasteable steps: https://github.com/substratusai/kubea...


Learn how to deploy Weaviate, Embedding and Generate models all within the same K8s cluster. It works on both CPU or GPU, but in the tutorial CPU is used.