LLMKube

LLMKube: Kubernetes operator for LLM inference with pluggable runtimes (llama.cpp, vLLM, TGI, Ollama, vllm-swift), multi-GPU sharding, NVIDIA CUDA + Apple Silicon Metal support, and OpenAI-compatible API.

Official website: llmkube.com

Official website checked

Features not verified. Product identity was matched to the official website. We have not tested this product hands-on.

LLMKube - Run models on your own hardware with Kubernetes

Category: Self-hosted web apps. First seen: 2026-11-16. Last source check: 2026-11-16.