Repository navigation
[Doc] cookbook: Refresh SemiAnalysis AgentX launches to InferenceX main ce35bc93 - #48857
Merged
nvpohanh merged 1 commit intoNov 6, 2026
Merged
Conversation
…in ce35bc93 Mirror the SemiAnalysis InferenceX AgentX SGLang / Dynamo+SGLang lanes at InferenceX main ce35bc93 (adds the Kimi-K3.1-Pro B200 and GB200 Dynamo+SGLang lanes from InferenceX sgl-project#4801 / sgl-project#4804; sgl-project#4811, sgl-project#4707, sgl-project#4670 and sgl-project#4673 merged), with InferenceX PRs sgl-project#4853 (Qwen3.5 GB300 Dynamo+SGLang on the SGLang nightly with NVIDIA megakernels), sgl-project#4850 / sgl-project#4787 (Qwen3.8-Flash-Next B200 / GB300 SGLang) and sgl-project#4757 (Muse Spark Open GB300 Dynamo+SGLang) overlaid. The AgentX component now takes per-point config files (point.files), for points whose nginx.conf / router policy differ from the first point of their deployment (Qwen3.5 GB300 3P1D c720). Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
nvpohanh
requested review from
JustinTong0323,
sogalin,
wisclmy0611 and
zijiexia
as code owners
November 6, 2026 08:34
Contributor
✅ Preview approved@nvpohanh approved a Mintlify preview for commit |
This was referenced Nov 6, 2026
Contributor
|
Preview deployment for your docs. Learn more about Mintlify Previews.
💡 Tip: Enable Automations to automatically generate PRs for you. |
Collaborator
Author
|
preview looks good. merging |
This was referenced Nov 9, 2026
This branch was successfully deployed
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
[by Claude Code]
Motivation
The cookbook's Agentic Long-Context Deployment sections (#42726, #43083, #43799, #43983, #44065, #44228, #44654, #44712, #45039, #45111, #45311, #45513, #45749, #46005, #46506, #46547, #46807, #46948, #47027, #47214, #47464, #47929, #48392, #48551, #48634) mirror SemiAnalysis InferenceX AgentX submissions as raw launch commands, each linked to the run that measured it. The configurations are mirrored from SemiAnalysis submissions. This PR:
Syncs every page to InferenceX
main(ce35bc93). New or updated merged lanes come from their dashboard runs:main, with the same runs and commands as in [Doc] cookbook: Refresh SemiAnalysis AgentX launches to InferenceX main 2ad2c9f9 #48634.The Kimi-K3.1-Pro page gets GB200 and B200 hardware options (GB300, GB200, B300, B200, plus MI355X). The MI355X data stays the hand-maintained file from [Doc] cookbook: Add Kimi-K3.1-Pro deployment recipes #48413.
Overlays four open InferenceX PRs:
nightly-dev-cu13-20261106-858073e4) with NVIDIA megakernels: new agg and disagg points.Source
InferenceX
main(ce35bc93), with these InferenceX PRs overlaid:qwen3.5-fp4-gb300-dynamo-sglang-agentic-agg,-disagg/useyet: in progress at head2c6b0317qwen3.8next-fp4-b200-sglang-agentic-mtp/useyet: in progress at headfcf2a217qwen3.8next-fp4-gb300-sglang-agentic-mtp/useyet: in progress at head1aa39c5bmusespark-fp4-gb300-dynamo-sglang-agentic-dflash-agg,-disagg/useyet: in progress at head7caf5718"In progress" lanes are rendered at the PR head and labeled "In progress in SA InferenceX AgentX". A later sync pins them once the PR gets a
/userun or merges.qwen3.5-fp4-gb300-dynamo-sglang-agentic-agg/-disagg, replacing the pointsmainmeasured in InferenceX #2477's run (2026-08-07). It also deletesqwen3.5-fp4-gb300-dynamo-sglang-agentic-agg-paretoand-pp-pareto(InferenceX #2812, 2026-09-09), which therefore leave the page, as they would when the PR merges. Where two of its points share a shape and a concurrency, the deployment is split by the flag that differs:--gc-threshold(also prefill-only for 1P1D TP4/TP8 c8) and--linear-attn-prefill-backend.mainmeasured in InferenceX #2751's run (2026-09-15).main, and its two keys exist only on its branch. The MiniMax-M3.1-Flash GB200 SGLang lane frommainstays.musespark-fp4-h100-sglang-agentic-dflashandqwen3.5-fp8-h100-sglang-agentic. The dashboard has no rows for them.mainwas frozen for this PR atce35bc93. Later merges are left for the next refresh.What this PR does
SGLANG_PLB_SCATTER_DEFER=1. The decode worker queues incoming PD KV scatters and runs them between forward passes instead of on arrival (SGLang default off)._agentx.jsx): a point can now carry its own config files (point.files) when they differ from the first point of its deployment. Before, every point showed the first point's files. In the Qwen3.5 GB300 3P1D PP4/DEP8 deployment, c720 runs 4 Dynamo frontends behind nginx and no--router-policy-config. It would otherwise have shown c704's 2-frontendnginx.confand a strayrouter_policy_config.yamltab. No other point on any page is affected.mainSHA and the overlay list).Validation
Browser checks: every page this PR changes was rendered in a headless browser (
mint dev, Mintlify as in CI).Decode and KV-flag checks:
Arg-parse: all 296 commands not validated in an earlier round parse. Each image was parsed with itself; both platforms of each image are built from the same commit:
nightly-dev-cu13-20261106-858073e4858073e4dev-kimi-k31-pro586355a8v0.5.23-cu130297e54fdnode scripts/check_cookbook_configs.mjs,mint broken-links --check-anchors --check-redirects,mint validateandpre-commit run --all-files(inlmsysorg/sglang:dev-cu13) pass.🤖 Generated with Claude Code
CI States
Latest PR Test (Base): ✅ Run #42188658741
Latest PR Test (Extra): ❌ Run #42188658641
Latest PR Test (AMD ROCm 10): ➖ No AMD PR run found for this commit.
Tip
Base CI only covers the core cases, and its workload may not exercise your change. Use
/rerun-testto run the tests your change touches, or copy this prompt for an agent: