Skip to content

vllm.models.kimi_k3.nvidia.specialized_decode.cutedsl.gemm

Modules:

  • decode –

    The attention input projection of a decode step, one engine per prepared row count.

  • projection –

    Split-K projection on the FlashInfer CuTe core vendored in splitk.py (with an

  • splitk –

    FlashInfer 0.7.0.post1 SplitKDenseGemmKernel (dense_bf16_gemm_sm100_splitk)

  • warp_splitk –

    FlashInfer's cp.async-pipelined BF16 GEMM for M <= 32 whose four compute warps hold

  • ws_gemm –

    Weight-stationary skinny GEMM for the MoE front: y[M, N] = x[M, K] @ W[N, K]^T.