Skip to content

fix(recipes): [cherry-pick 1.7.0] use the CuTe DSL W4A16 MoE backend for Qwen3.6-35B-A3B NVFP4 on SGLang (#16879) - #18488

Merged
ynpandey-nv merged 1 commit into
release/1.7.0from
ynpandey-nv/cp-16879-qwen3.6-cutedsl-to-release-1.7.0
Nov 10, 2026
Merged

ynpandey-nv merged 1 commit into
release/1.7.0from
ynpandey-nv/cp-16879-qwen3.6-cutedsl-to-release-1.7.0

Conversation

@ynpandey-nv

Copy link
Copy Markdown
Contributor

Cherry-picks the merged #16879 squash (50832471ad59ec064cec022a4549ba7bffc3191e) from main onto release/1.7.0.

The Qwen3.6-35B-A3B SGLang agg MTP recipes for B200 and GB200 crash on SGLang 0.5.20 and later, which the 1.6.0 and 1.7.0 runtime images ship. nvidia/Qwen3.6-35B-A3B-NVFP4 experts are W4A16_NVFP4, and on SM100 SGLang rejects --moe-runner-backend flashinfer_cutlass for them. Both recipes now use --moe-runner-backend flashinfer_cutedsl with --moe-a2a-backend none and set SGLANG_FLASHINFER_CUTEDSL_NVFP4_W4A16=1.

  • The recipe, catalog, and docs paths touched here are byte-identical to main (verified: git diff 50832471ad -- <paths> is empty).
  • The cherry-pick applied cleanly with no conflicts (git cherry-pick -x).
  • Files: recipes/qwen3.6-35b-a3b/sglang/agg-b200-mtp/deploy.yaml, recipes/qwen3.6-35b-a3b/sglang/agg-gb200-mtp/deploy.yaml, docs/fern/pages/recipes/_catalog/recipes/qwen3-6-35b-a3b.yaml, docs/fern/pages/recipes/model-recipes/qwen3-6-35b-a3b.mdx.

Ref DYN-5518

…for Qwen3.6-35B-A3B NVFP4 on SGLang (#16879)

(cherry picked from commit 5083247)
Signed-off-by: Yogendra Pandey <ypandey@nvidia.com>
@ynpandey-nv
ynpandey-nv requested review from a team as code owners November 9, 2026 23:39
@copy-pr-bot

copy-pr-bot Bot commented Nov 9, 2026

Copy link
Copy Markdown

This pull request requires additional validation before any workflows can run on NVIDIA's runners.

Pull request vetters can view their responsibilities here.

Contributors can view more details about this message here.

@github-actions github-actions Bot added fix documentation Improvements or additions to documentation labels Nov 9, 2026
@ynpandey-nv

Copy link
Copy Markdown
Contributor Author

/ok to test 1f28bb0

@github-actions

github-actions Bot commented Nov 9, 2026

Copy link
Copy Markdown
Contributor

@ynpandey-nv
ynpandey-nv merged commit 7092c35 into release/1.7.0 Nov 10, 2026
106 of 107 checks passed
@ynpandey-nv
ynpandey-nv deleted the ynpandey-nv/cp-16879-qwen3.6-cutedsl-to-release-1.7.0 branch November 10, 2026 00:00
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

documentation Improvements or additions to documentation fix size/M

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant