LLMKube
LLMKube: Kubernetes operator for LLM inference with pluggable runtimes (llama.cpp, vLLM, TGI, Ollama, vllm-swift), multi-GPU sharding, NVIDIA CUDA + Apple Silicon Metal support, and OpenAI-compatible API.
Official website checked
Features not verified. Product identity was matched to the official website. We have not tested this product hands-on.
LLMKube - Run models on your own hardware with Kubernetes
Category: Self-hosted web apps. First seen: 2026-11-16. Last source check: 2026-11-16.