Feature Guide

This section provides an overview of the features implemented in vLLM Ascend. Developers can refer to this guide to understand how vLLM Ascend works.

Feature Guide

• Patch in vLLM Ascend
• Prepare inputs for model forwarding
• Disaggregated-prefill
• Expert Parallelism Load Balancer (EPLB)
• ACL Graph
• KV Cache Pool
• Adding a custom aclnn operation
• Context Parallel (CP)
• Quantization Adaptation Guide
• Npugraph_ex