Skip to content

Faster MoE token generation on CUDA#248

Merged
ikawrakow merged 4 commits into
mainfrom
ik/cuda_faster_moe_tg
Mar 10, 2025
Merged

Faster MoE token generation on CUDA#248
ikawrakow merged 4 commits into
mainfrom
ik/cuda_faster_moe_tg

Guard against numerical precision issues for MLA on CUDA

cfec338
Select commit
Loading
Failed to load commit list.

Workflow runs completed with no jobs