Repository navigation
[Doc] cookbook: Refresh SemiAnalysis AgentX launches to InferenceX main a0f8080c - #49787
Merged
nvpohanh merged 1 commit intoNov 11, 2026
Merged
Conversation
…in a0f8080c Sync every Agentic Long-Context Deployment section to InferenceX main a0f8080c with InferenceX sgl-project#5006 (Qwen3.5 B300 SGLang), sgl-project#4964 (Kimi-K3.1-Pro B200 Dynamo+SGLang) and sgl-project#4853 (Qwen3.5 GB300 Dynamo+SGLang) overlaid. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
nvpohanh
requested review from
JustinTong0323,
sogalin,
wisclmy0611 and
zijiexia
as code owners
November 11, 2026 08:43
Contributor
✅ Preview approved@nvpohanh approved a Mintlify preview for commit |
This was referenced Nov 11, 2026
Contributor
|
Preview deployment for your docs. Learn more about Mintlify Previews.
💡 Tip: Enable Automations to automatically generate PRs for you. |
Collaborator
Author
|
preview looks good. merging |
This was referenced Nov 12, 2026
This branch was successfully deployed
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
[by Claude Code]
Motivation
The cookbook's Agentic Long-Context Deployment sections (#42726, #43083, #43799, #43983, #44065, #44228, #44654, #44712, #45039, #45111, #45311, #45513, #45749, #46005, #46506, #46547, #46807, #46948, #47027, #47214, #47464, #47929, #48392, #48551, #48634, #48857, #49260) mirror SemiAnalysis InferenceX AgentX submissions as raw launch commands, each linked to the run that measured it. The configurations are mirrored from SemiAnalysis submissions. This PR:
main(a0f8080c). New or updated merged lanes come from their dashboard runs:--hicache-sizeon the GB300 SGLang points and on the Dynamo+SGLang agg c1 / c36 points is therefore now 140, the value of the closest measured GB300 HiCache worker (it was 150).-dspark,-dspark-lowconc): InferenceX #4900, run 42564578697, 2026-11-11. The image is nownightly-dev-cu13-20261107-e45e1d0c; the commands are unchanged.Source
InferenceX
main(a0f8080c), with these InferenceX PRs overlaid:qwen3.5-fp4-b300-sglang-agentic-mtp-pareto(new)/useyet: in progress at headc01d1923kimik3.1-fp4-b200-dynamo-sglang-agentic-dflash/useyet: in progress at heade986c470qwen3.5-fp4-gb300-dynamo-sglang-agentic-agg,-disagg/useyet: in progress at headc914e43c"In progress" lanes are rendered at the PR head and labeled "In progress in SA InferenceX AgentX". A later sync pins them once the PR gets a
/userun or merges.mainmeasured in InferenceX #4801's run with eight TP16 EP4 DCP8 points (c1, 2, 4, 12, 16, 20, 24, 28) on the same image. The submitted frontend is now Dynamo with the KV router (it was the SGLang router).nightly-dev-20261013-7224fce1: TP4 at c4-16, TP4·EP4 at c22 / 26, TP2·EP2 at c16-48, and TP2·EP2 with HiCache at c64.--hicache-ratio 1.0(was 1.5), and the c392 decode workers use--mem-fraction-static 0.72(was 0.76). As in [Doc] cookbook: Refresh SemiAnalysis AgentX launches to InferenceX main 0d7f94e7 #49260,qwen3.5-fp4-gb300-dynamo-sglang-agentic-agg-paretoand-pp-paretostay off the page, because the PR deletes them.musespark-fp4-h100-sglang-agentic-dflashandqwen3.5-fp8-h100-sglang-agentic. The dashboard has no rows for them.mainwas frozen for this PR ata0f8080c. Later merges are left for the next refresh.What this PR does
--enable-mscclpp,--load-format runai_streamer, andMSCCLPP_HCA_DEVICES. The last one names the node's RDMA NICs, so it is shown as the$IB_DEVICESplaceholder.--soft-watchdog-timeout 60on the TP2·EP2 HiCache c64 point. It only dumps debugging information when a forward batch runs longer than that.mainSHA and the overlay list). MiniMax-M3.1's per-point provenance is regrouped, with the same values.Validation
Browser checks: every page this PR changes was rendered in a headless browser (
mint dev, Mintlify as in CI).Decode and KV-flag checks:
Arg-parse: all 179 commands not validated in an earlier round parse. Each image was parsed with itself:
nightly-dev-20261013-7224fce17224fce1nightly-dev-cu13-20261107-e45e1d0ce45e1d0cdev-kimi-k31-pro586355a8nightly-dev-cu13-20261030-302b78cc302b78cc, arm6452604e1dnightly-dev-cu13-20261106-858073e4858073e4nightly-dev-cu13-20261103-797af717797af717The 10
302b78cccommands are Muse Spark GB300 (arm64), so they were also parsed with the52604e1dsource and passed.node scripts/check_cookbook_configs.mjs,mint broken-links --check-anchors --check-redirects,mint validateandpre-commit run --all-files(inlmsysorg/sglang:dev-cu13) pass.🤖 Generated with Claude Code
CI States
Latest PR Test (Base): ✅ Run #42989333625
Latest PR Test (Extra): ❌ Run #42989333335
Latest PR Test (AMD ROCm 10): ➖ No AMD PR run found for this commit.
Tip
Base CI only covers the core cases, and its workload may not exercise your change. Use
/rerun-testto run the tests your change touches, or copy this prompt for an agent: