Repository navigation
[NVIDIA][AgentX] MiniMax-M3.1-Flash GB300 SGLang AgentX: day-zero recipe with low-latency c1 and L2 HiCache / [NVIDIA][AgentX] MiniMax-M3.1-Flash GB300 SGLang AgentX:首发配置,含低延迟 c1 与 L2 HiCache - #4456
edwingao28 merged 6 commits into
Conversation
… c1 and L2 HiCache Day-zero MiniMax-M3.1-Flash (NVFP4) AgentX on GB300 with the SGLang cookbook's GB300 cells: Balanced TP4 at conc 1-32, Low-Latency MSA-V1 MonoKernel at conc 1 (agentic-low-latency.yaml), and High-Throughput TP4 + EP4 at conc 32-128 with L2 HiCache (write_back, hicache-size 175 GB per rank) above conc 32, within the gb300-nv 920,000 MiB step memory cap. 新增 MiniMax-M3.1-Flash(NVFP4)在 GB300 上的 SGLang AgentX 首发配置, 采用 SGLang cookbook 的 GB300 配置:Balanced TP4 覆盖 conc 1-32; Low-Latency(MSA-V1 MonoKernel)用于 conc 1(agentic-low-latency.yaml); High-Throughput TP4 + EP4 覆盖 conc 32-128,conc 大于 32 时启用 L2 HiCache (write_back,每个 rank 175 GB),保持在 gb300-nv 920,000 MiB 的 step 内存上限内。 Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
97984ec to
688df9a
Compare
|
Dispatched trusted sweep run for approved external revision 已为获批的外部提交 |
Resolve the perf-changelog conflict with SemiAnalysisAI#4444 via prepare_perf_changelog_merge. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
|
Dispatched trusted sweep run for approved external revision 已为获批的外部提交 |
Resolve the perf-changelog conflict via prepare_perf_changelog_merge. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Balanced TP4 with TRT-LLM routed MoE, scheduler and decode graph batch 128, and write_back HiCache at 180 GB per rank. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
|
Dispatched trusted sweep run for approved external revision 已为获批的外部提交 |
Resolve the perf-changelog conflict via prepare_perf_changelog_merge. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
…ride Pair CONC with max-running-requests and cuda-graph-max-bs-decode in one zip_override_tp4 block; every resolved recipe and matrix fingerprint is unchanged. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
|
Supplementary MonoKernel C1 evaluation passed full GSM8K: 96.59% across 1,319 questions, using the same pinned image and unchanged MonoKernel recipe. Retained GPU traces confirm actual MonoKernel execution during evaluation. |
Summary
Day-zero MiniMax-M3.1-Flash (NVFP4) AgentX on GB300 with SGLang, using the SGLang cookbook's GB300 configs. Replaces #4443.
AI model disclosure
claude-opus-5-5)PR checklist and change type
Type of Change
Checklist
python -m infx.matrix.changed --base origin/mainlists affected config keys, I have appended one new entry covering them to the physical end ofinferencex-e2e/perf-changelog.yaml; if it lists none, I have added none. I have not edited historical entriesinferencex-e2e/perf-changelog.yamlentry, it carries exactly one primary sweep label (a maintainer applies it on fork PRs):full-sweep-fail-fast(recommended),full-sweep-enabled, ornon-canary-full-sweep-enabled. Optional modifiersall-evals,evals-only, andagentx-fastrequire a primary label; the last two block reuse while applied.OWNER/MEMBER/COLLABORATOR) has commented/use <run_id>(or the legacy/reuse-sweep-run) on this PR. Do this only once there is a final full sweep that is all green with evals passing, since after this comment the primary sweep label will no longer automatically kick off new sweeps. Remove and re-add the primary sweep label to force a new sweep.中文
按 SGLang cookbook 的 GB300 配置,新增 MiniMax-M3.1-Flash(NVFP4)在 GB300 上的 SGLang AgentX 首发配置,取代 #4443。
AI 模型使用说明:Claude Opus 5.5(
claude-opus-5-5)编写了 recipe、master config 和 perf-changelog 的改动并起草本说明;参数由作者决定,diff 也经作者审阅。🤖 Generated with Claude Code