Repository navigation
[Klaud Cold] Update DeepSeek-V4-Pro FP4 GB200 Dynamo-SGLang AgentX disagg image to v0.5.22-cu130 / [Klaud Cold] 将 DeepSeek-V4-Pro FP4 GB200 Dynamo-SGLang AgentX 分离式镜像更新至 v0.5.22-cu130 - #4329
Conversation
…2-cu130 Pin lmsysorg/sglang:v0.5.22-cu130 by digest for dsv4-fp4-gb200-dynamo-sglang-agentic-disagg and drop SGLANG_OPT_SWA_SPLIT_LEAF_ON_INSERT, which upstream removed with the legacy SWA radix cache (sgl-project/sglang#40313). 将 dsv4-fp4-gb200-dynamo-sglang-agentic-disagg 的镜像更新为按摘要固定的 lmsysorg/sglang:v0.5.22-cu130,并删除上游随旧版 SWA radix cache 一并移除的 SGLANG_OPT_SWA_SPLIT_LEAF_ON_INSERT 环境变量(sgl-project/sglang#40313)。 Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
SGLang v0.5.22 resolves DP attention into attn_dp_size and leaves dp_size=1 (sgl-project/sglang#41818). Dynamo 1.5.0.dev20260910 derives local DP ranks from dp_size only, so the KV router sent every prefill to DP rank 0. Use Dynamo 1.6.0.dev20261014, which counts ranks from attn_dp_size (ai-dynamo/dynamo#16005). Raise c128 prefill mem-fraction-static to 0.815 because the v0.5.22 weight footprint left only 334k prefill KV tokens. SGLang v0.5.22 将 DP attention 解析为 attn_dp_size,并保持 dp_size=1 (sgl-project/sglang#41818)。Dynamo 1.5.0.dev20260910 只根据 dp_size 推导本地 DP rank,导致 KV router 把所有 prefill 请求都发往 DP rank 0。 改用按 attn_dp_size 计数的 Dynamo 1.6.0.dev20261014(ai-dynamo/dynamo#16005)。 由于 v0.5.22 权重占用增加后 prefill KV 仅剩 334k token,将 c128 的 prefill mem-fraction-static 提高到 0.815。 Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
|
Thanks for the contribution!
中文感谢你的贡献!
|
|
Initial attempt · Running · Run 39308319786 / attempt 1 · 2026-10-19 19:42 UTC Next: The c128 eval passed and its prefill logs show batches spread across DP ranks 0-7 with Dynamo 1.6.0.dev20261014, but prefill KV holds only 540k tokens at 0.815, below the 670k-token warmup prompts, so repair 1 raises c128 to 0.83; the earlier c128 benchmark failure was a pyxis nginx import error on watchtower-navy-cn05, and the remaining evals here stay queued. 中文初次尝试 · 运行中 · Run 39308319786 / attempt 1 · 2026-10-19 19:42 UTC |
At mem-fraction-static 0.815 the c128 prefill pool holds 540k tokens, below the 670k-token AgentX warmup prompts; 0.83 restores about the baseline's 735k tokens and stays below the c64 point's 0.85. 在 mem-fraction-static 0.815 时,c128 prefill KV 池仅 540k token,低于 670k token 的 AgentX warmup 请求;0.83 可恢复到约基线的 735k token,且 仍低于 c64 点使用的 0.85。 Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
|
Repair 1/5 · Running · Run 39313265645 / attempt 1 · 2026-10-20 03:36 UTC Next: The repair c128 smoke benchmark started on gb200-nv at about 03:40 UTC after eight hours queued, and the initial run c64 eval is also running; wait for both. 中文修复 1/5 · 运行中 · Run 39313265645 / attempt 1 · 2026-10-20 03:36 UTC |
|
resumed · The session ended before finishing; session 2 continues it in a new run of its planner. 中文resumed · 会话未完成即已结束;第 2 个会话将在其规划运行的新运行中继续。 |
|
Repair 1/5 · Queued · Run 39313265645 / attempt 2 · 2026-10-20 03:51 UTC Next: The dashboard bot cancelled all of run 39313265645 attempt 1 at 03:46 UTC, including the c128 benchmark 14 minutes after it started and before any result, so the preempted jobs were rerun on the same head as attempt 2 and are queued again. 中文修复 1/5 · 排队中 · Run 39313265645 / attempt 2 · 2026-10-20 03:51 UTC |
|
Repair 1/5 · Running · Run 39313265645 / attempt 3 · 2026-10-20 14:32 UTC
Note: All rows: Δ N/A: dataset/scenario/statistic mismatch.
Next: The c64 and c128 smoke benchmarks and evals passed on run 39313265645 attempt 3 with zero request errors; the c256, c768, c1024 and c1280 benchmarks and evals remain queued on gb200-nv, so keep waiting. 中文修复 1/5 · 运行中 · Run 39313265645 / attempt 3 · 2026-10-20 14:32 UTC |
|
resumed · The session ended before finishing; session 3 continues it in a new run of its planner. 中文resumed · 会话未完成即已结束;第 3 个会话将在其规划运行的新运行中继续。 |
|
resumed · The session ended before finishing; session 4 continues it in a new run of its planner. 中文resumed · 会话未完成即已结束;第 4 个会话将在其规划运行的新运行中继续。 |
|
Repair 1/5 · Queued · Run 39313265645 / attempt 4 · 2026-10-20 15:40 UTC
Note: All rows: Δ N/A: dataset/scenario/statistic mismatch.
Next: The dashboard bot cancelled the queued c256-c1280 jobs (and the c768 benchmark 16 minutes after it started) at 15:35 UTC and reran them as attempt 4; c64 and c128 results from attempt 3 are kept, and the four remaining benchmarks and evals are queued again. 中文修复 1/5 · 排队中 · Run 39313265645 / attempt 4 · 2026-10-20 15:40 UTC |
|
unexpected-error · Cleanup pending. Stop and confirm owned runs before closing. 中文unexpected-error · 清理待完成。先停止并确认自有运行结束,再关闭 PR。 |
|
unexpected-error · Repairs: unknown · Runs: 39308319786, 39313265645 中文unexpected-error · 修复次数:unknown · 运行:39308319786, 39313265645 |
Goal: Update SGLang image from lmsysorg/sglang:nightly-dev-20260916-c9a8fba9 to lmsysorg/sglang:v0.5.22-cu130.
Baseline: 2026-10-12 ·
lmsysorg/sglang:nightly-dev-20260916-c9a8fba9Mean latency · Sources: API 1, API 2, API 3
Stop: Add the
klaud-abortlabel at any time to stop this candidate now; Klaud cancels its runs, closes this PR and does not retry it. Remove the label to let the planner pick it up again.中文
**目标:**将 SGLang 镜像从 lmsysorg/sglang:nightly-dev-20260916-c9a8fba9 更新至 lmsysorg/sglang:v0.5.22-cu130。
**基线:**2026-10-12 ·
lmsysorg/sglang:nightly-dev-20260916-c9a8fba9平均延迟 · 来源: API 1, API 2, API 3;数值及异常说明见上表。
**停止:**随时添加
klaud-abort标签即可立即停止该候选:Klaud 会取消其运行、关闭此 PR 且不再重试。移除该标签后,规划器会在下次扫描时重新考虑它。