跳转至

Qwen

Alibaba Qwen model tutorials currently published by vLLM Ascend.

Models

Model vLLM Ascend latest guide
Qwen3-Dense(0.6B/1.7B/4B/8B/14B/32B) Official guide
Qwen-VL-Dense(8B/32B) Official guide
Qwen3-30B-A3B Official guide
Qwen3-235B-A22B Official guide
Qwen3-VL-30B-A3B-Instruct Official guide
Qwen3-VL-235B-A22B-Instruct Official guide
Qwen3-Coder-30B-A3B Official guide
Qwen3-Embedding Official guide
Qwen3-VL-Embedding Official guide
Qwen3-Reranker Official guide
Qwen3-VL-Reranker Official guide
Qwen3-Next Official guide
Qwen3-Omni-30B-A3B-Thinking Official guide
Qwen3.5-27B & Qwen3.6-27B Official guide
Qwen3.5-Dense (2B/4B/9B) Official guide
Qwen3.5-397B-A17B Official guide
Qwen3.6-35B-A3B Official guide
Qwen3.8-2.4T-A95B Official guide
Qwen3.8-27B Official guide
Qwen3-ASR-1.7B Official guide
Qwen2.5-Math-RM-72B Official guide

Serving engine

Status: Placeholder

This tab is reserved for Qwen deployment recipes on vLLM with UCM.

What to add

  • Supported Qwen models and tested vLLM/UCM versions
  • Docker Image or wheel installation
  • UCM configuration and vllm serve command
  • Verification request, expected result, and known limitations

Status: Placeholder

This tab is reserved for Qwen deployment recipes on vLLM Ascend with UCM.

What to add

  • Supported Qwen models and A2/A3/A5 validation status
  • Tested vLLM Ascend, CANN, and UCM versions
  • UCM configuration and serving command
  • Verification request, expected result, and hardware notes

Status: Placeholder

This tab is reserved for Qwen deployment recipes on SGLang with UCM.

What to add

  • Supported Qwen models and tested SGLang/UCM versions
  • Installation and launch command
  • UCM configuration
  • Verification request, expected result, and known limitations