Qwen¶
Alibaba Qwen model tutorials currently published by vLLM Ascend.
Models¶
| Model | vLLM Ascend latest guide |
|---|---|
| Qwen3-Dense(0.6B/1.7B/4B/8B/14B/32B) | Official guide |
| Qwen-VL-Dense(8B/32B) | Official guide |
| Qwen3-30B-A3B | Official guide |
| Qwen3-235B-A22B | Official guide |
| Qwen3-VL-30B-A3B-Instruct | Official guide |
| Qwen3-VL-235B-A22B-Instruct | Official guide |
| Qwen3-Coder-30B-A3B | Official guide |
| Qwen3-Embedding | Official guide |
| Qwen3-VL-Embedding | Official guide |
| Qwen3-Reranker | Official guide |
| Qwen3-VL-Reranker | Official guide |
| Qwen3-Next | Official guide |
| Qwen3-Omni-30B-A3B-Thinking | Official guide |
| Qwen3.5-27B & Qwen3.6-27B | Official guide |
| Qwen3.5-Dense (2B/4B/9B) | Official guide |
| Qwen3.5-397B-A17B | Official guide |
| Qwen3.6-35B-A3B | Official guide |
| Qwen3.8-2.4T-A95B | Official guide |
| Qwen3.8-27B | Official guide |
| Qwen3-ASR-1.7B | Official guide |
| Qwen2.5-Math-RM-72B | Official guide |
Serving engine¶
Status: Placeholder
This tab is reserved for Qwen deployment recipes on vLLM with UCM.
What to add
- Supported Qwen models and tested vLLM/UCM versions
- Docker Image or wheel installation
- UCM configuration and
vllm servecommand - Verification request, expected result, and known limitations
Status: Placeholder
This tab is reserved for Qwen deployment recipes on vLLM Ascend with UCM.
What to add
- Supported Qwen models and A2/A3/A5 validation status
- Tested vLLM Ascend, CANN, and UCM versions
- UCM configuration and serving command
- Verification request, expected result, and hardware notes
Status: Placeholder
This tab is reserved for Qwen deployment recipes on SGLang with UCM.
What to add
- Supported Qwen models and tested SGLang/UCM versions
- Installation and launch command
- UCM configuration
- Verification request, expected result, and known limitations