Skip to content

Commit 5c98a2e

Browse files
committed
[tuner] Stop enumerating a16w16 stage2 reduce kernels.
bf16 stage2 has no reduce epilogue, so those names atomic-scatter into an unzeroed buffer and fail accuracy.
1 parent efae9dc commit 5c98a2e

1 file changed

Lines changed: 3 additions & 1 deletion

File tree

‎aiter/ops/flydsl/moe_kernels.py‎

Lines changed: 3 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -687,7 +687,9 @@ def get_flydsl_stage2_kernels_a16w16(out_dtype: str) -> dict[str, dict]:
687687
tile_ks = [128, 256]
688688
tile_ms = [16, 32, 64, 128]
689689
tile_ns = [128]
690-
modes = ["atomic", "reduce"]
690+
# bf16 stage2 has no reduce epilogue (int4 only). A "reduce" name still
691+
# atomic-scatters into an unzeroed buffer. See ROCm/aiter#6724.
692+
modes = ["atomic"]
691693

692694
for tm in tile_ms:
693695
for tn in tile_ns:

0 commit comments

Comments
 (0)