Deployment Frameworks¶
Guides for deploying UCM with upstream serving and orchestration frameworks.
Supported frameworks¶
- Kubernetes — deploy single, multi-node, and PD inference engines with the kthena-based Helm chart
- pyMotor — run vLLM-style PD disaggregation on Ascend with UCM as the persistent KV cache store backend