Repository navigation
[Klaud Cold] Update DeepSeek-V4-Pro FP4 B200 Dynamo-SGLang AgentX disagg image to v0.5.21-cu130 / [Klaud Cold] 将 DeepSeek-V4-Pro FP4 B200 Dynamo-SGLang AgentX 分离式镜像更新至 v0.5.21-cu130 - #4176
Conversation
…-cu130 Pin lmsysorg/sglang:v0.5.21-cu130 by digest for dsv4-fp4-b200-dynamo-sglang-agentic-disagg and drop SGLANG_OPT_SWA_SPLIT_LEAF_ON_INSERT, whose only reader was removed upstream with the legacy SWA radix cache (sgl-project/sglang#40313). 将 dsv4-fp4-b200-dynamo-sglang-agentic-disagg 的镜像按摘要固定为 lmsysorg/sglang:v0.5.21-cu130,并移除 SGLANG_OPT_SWA_SPLIT_LEAF_ON_INSERT; 上游已随旧版 SWA radix cache 一并删除其唯一读取方(sgl-project/sglang#40313)。 Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
|
Thanks for the contribution!
中文感谢你的贡献!
|
|
Initial attempt · Passed · Run 38905008779 / attempt 1 · 2026-10-16 15:36 UTC
Note: All rows: Δ N/A: dataset/scenario/statistic mismatch.
Note: All rows: Δ N/A: no matched eval baseline. Next: Append the perf-changelog entry and run the full sweep on the updated image with full-sweep-fail-fast. 中文初次尝试 · 已通过 · Run 38905008779 / attempt 1 · 2026-10-16 15:36 UTC |
合并 origin/main。 Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
…date Append the perf-changelog entry for dsv4-fp4-b200-dynamo-sglang-agentic-disagg. 为 dsv4-fp4-b200-dynamo-sglang-agentic-disagg 追加 perf-changelog 条目。 Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
|
Final full sweep · Passed · Run 38925477096 / attempt 1 · 2026-10-16 18:27 UTC
Note: All rows: Δ N/A: dataset/scenario/statistic mismatch.
Note: All rows: Δ N/A: no matched eval baseline. Next: Mark ready for maintainer review. 中文最终完整 sweep · 已通过 · Run 38925477096 / attempt 1 · 2026-10-16 18:27 UTC |
|
View unofficial run (performance): https://inferencex.semianalysis.com/inference?unofficialRun=38925477096 View unofficial run (accuracy): https://inferencex.semianalysis.com/evaluation?unofficialRun=38925477096 |
|
validated · Repairs: 0 · Runs: 38905008779, 38925392693, 38925477096 中文validated · 修复次数:0 · 运行:38905008779, 38925392693, 38925477096 |
|
/use 38925477096 |
|
@Klaud-Cold staged run 38925477096. This run remains available across future |
There was a problem hiding this comment.
I reviewed this PR and didn't find any bugs. The NVIDIA master config and the B200 srt-slurm recipes have designated code owners, so one of them should still sign off.
What was reviewed:
- The image bump for
dsv4-fp4-b200-dynamo-sglang-agentic-disagg. The digest is pinned, and it differs from the ARM64v0.5.21-cu130digest the GB300 Qwen entry uses, which is what you'd expect for an x86 B200 runner. - The
SGLANG_OPT_SWA_SPLIT_LEAF_ON_INSERTremoval from both worker env blocks of the B200 disagg recipe. The var is still in the B200 agg recipe and the GB200/GB300 recipes, but those use other config keys and images, so this PR doesn't affect them. - The perf-changelog entry. It only adds lines at the end of the file, covers the one affected key, and correctly leaves out
append-only, since this change alters existing points.
Extended reasoning...
The change touches three YAML files: an image tag and digest in nvidia-master.yaml, two env-var removals in one B200 FP4 AgentX disagg recipe, and a new perf-changelog entry. It has no security-sensitive surface. The change is small and mechanical, but CODEOWNERS assigns both nvidia-master.yaml and the b200-* srt-slurm recipes to specific owners, so approval is left to them.
Resolve perf-changelog.yaml by taking main's file and re-appending this PR's entry. 中文:合并 origin/main;perf-changelog.yaml 采用 main 版本,并在末尾重新追加本 PR 的条目。
Resolve conflicts: take main's refactored recipes and re-apply this PR's non-image edits; take main's perf-changelog.yaml and re-append this PR's entry. 中文:合并 origin/main;配方采用 main 重构后的版本并重新应用本 PR 的非镜像改动,perf-changelog.yaml 采用 main 版本并在末尾重新追加本 PR 的条目。
|
/reuse-sweep-run 38925477096 |
Goal: Update SGLang image from
lmsysorg/sglang:nightly-dev-20260916-c9a8fba9tolmsysorg/sglang:v0.5.21-cu130@sha256:b1259f3ea3275f66237c498ea388919729018bc9f01c3d638391e06e2cf3f469.Baseline: 2026-09-22 ·
lmsysorg/sglang:nightly-dev-20260916-c9a8fba9Mean latency · Sources: API 1, API 2
Eval: N/A
中文
**目标:**将 SGLang 镜像从
lmsysorg/sglang:nightly-dev-20260916-c9a8fba9更新至lmsysorg/sglang:v0.5.21-cu130@sha256:b1259f3ea3275f66237c498ea388919729018bc9f01c3d638391e06e2cf3f469。**基线:**2026-09-22 ·
lmsysorg/sglang:nightly-dev-20260916-c9a8fba9平均延迟 · 来源: API 1, API 2;数值及异常说明见上表。