Buoyant launches Kinference for Kubernetes, with alpha limits
Kinference brings policy and cache aware routing to vLLM on Kubernetes. Its alpha still lacks rate limits, semantic classifiers and Anthropic style calls.
Kinference
Accessibility Adjustments
Use these optional tools to adjust reading and display preferences. These tools cannot resolve every accessibility barrier. Please contact the website owner if you need assistance.
Kinference brings policy and cache aware routing to vLLM on Kubernetes. Its alpha still lacks rate limits, semantic classifiers and Anthropic style calls.
