Skip to content

Deployment Frameworks

Guides for deploying UCM with upstream serving and orchestration frameworks.

Supported frameworks

  • Kubernetes — deploy single, multi-node, and PD inference engines with the kthena-based Helm chart
  • pyMotor — run vLLM-style PD disaggregation on Ascend with UCM as the persistent KV cache store backend