vllm.compilation.passes.fusion
¶
Modules:
-
act_quant_fusion– -
add_rms_fusion– -
allreduce_rms_fusion– -
attn_quant_fusion– -
matcher_utils– -
mla_attn_quant_fusion– -
muse_glimmer_sandwich_norm_fusion–Fuse Muse's Gemma-style RMSNorm, residual add, and second RMSNorm.
-
qk_norm_rope_fusion– -
qk_norm_rope_kvcache_fusion– -
rms_quant_fusion– -
rocm_aiter_fusion– -
rope_kvcache_fusion–