Search. Pull. Build.

LMCache is an LLM serving engine extension that stores and reuses KV caches across requests to reduce time-to-first-token (TTFT) and increase throughput. It integrates with vLLM to provide GPU-accelerated inference with shared KV cache management.

Kubernetes operator for the vLLM Production Stack, vLLM's reference system for K8S-native cluster-wide deployment, that manages LoRA adapters, vLLM runtimes, routers and cache servers through CRDs.

FIPS-enabled Kubernetes operator for the vLLM Production Stack, vLLM's reference system for K8S-native cluster-wide deployment, that manages LoRA adapters, vLLM runtimes, routers and cache servers through CRDs.

Local Path Provisioner provides a way for the Kubernetes users to utilize the local storage in each node.

Minimal local-path-provisioner-fips image.

Helm chart for deploying local-static-provisioner.

The local volume node cleanup controller removes PersistentVolumes and PersistentVolumeClaims that reference deleted Nodes.