Skip to content

Faster CPU prompt processing for Trellis quants and MoE models#488

Merged
ikawrakow merged 2 commits into
mainfrom
ik/dequant_moe_gemm
Jun 5, 2025
Merged

Faster CPU prompt processing for Trellis quants and MoE models#488
ikawrakow merged 2 commits into
mainfrom
ik/dequant_moe_gemm

Also do the dequantize approach for iqk_moe_fused_up_gate

62d5e53
Select commit
Loading
Failed to load commit list.

Workflow runs completed with no jobs