Community
dot-inference
By devops-toolkitLast changed 3 months ago
Source Code
Notice something off about this package? Help us keep the marketplace safe and trustworthy by reporting inappropriate content or behavior.
Report this packageOverview
LLM inference on Kubernetes with vLLM and Crossplane
A Configuration package that defines an LLMInference type for deploying LLM models using vLLM Production Stack. Supports generative and embedding models with automatic GPU scaling, tensor parallelism, and Ingress routing.