🎬
Demo
See the current Proof of Concept in action: stack deployment on a Gardener cluster, images in Keppel, and the OpenAI-compatible API endpoint.
Watch the demo
ThalamusSovereign AI Infrastructure
A sovereign, vendor-neutral, and Kubernetes-native inference service based on vLLM, llm-d, the Gateway API inference extension, and Cortex.