Skip to content

[Klaud Cold] Update glm5.2-fp4-gb300-dynamo-sglang-agentic-disagg SGLang image to v0.5.19-cu130 / 将 glm5.2-fp4-gb300-dynamo-sglang-agentic-disagg 的 SGLang 镜像更新至 v0.5.19-cu130 - #3025

Closed
Klaud-Cold wants to merge 1 commit into
mainfrom
klaud/auto-68551d95238169ff-f7a6259862406d3d
Closed

Klaud-Cold wants to merge 1 commit into
mainfrom
klaud/auto-68551d95238169ff-f7a6259862406d3d

Conversation

@Klaud-Cold

@Klaud-Cold Klaud-Cold commented Sep 11, 2026 •

Copy link
Copy Markdown
Collaborator

Goal: Update SGLang image from lmsysorg/sglang:nightly-dev-cu13-20260805-211ee642 to lmsysorg/sglang:v0.5.19-cu130@sha256:d6e7288627be8b02be88e4bba38e73f6d50e2826869f753c13a4c4385ab3eda9.
Baseline: 2026-08-16 · lmsysorg/sglang:nightly-dev-cu13-20260805-211ee642
Mean latency · Sources: API 1, API 2, API 3

Point Total tok/s/GPU ↑ Output tok/s/GPU ↑ TTFT ms ↓ TPOT ms ↓
AgentX c48 PTP4x1/DTP4x2 aa1d55 N/A N/A N/A N/A
AgentX c48 PTP4x1/DTP4x4 e7eb7f N/A N/A N/A N/A
AgentX c45 PTP4x1/DTP4x6 de72ee N/A N/A N/A N/A
AgentX c128 PTP8x2/DTP16x1 8f3efc N/A N/A N/A N/A
AgentX c192 PTP8x2/DTP16x1 404052 N/A N/A N/A N/A

Note: All rows: unavailable.

Eval Score ↑ Samples
gsm8k/em_strict · c48 95.15% 1,319
gsm8k/em_strict · c48 95.45% 1,319
gsm8k/em_strict · c45 95.3% 1,319
gsm8k/em_strict · c128 94.01% 1,319
gsm8k/em_strict · c192 94.47% 1,319
中文

**目标:**将 SGLang 镜像从 lmsysorg/sglang:nightly-dev-cu13-20260805-211ee642 更新为 lmsysorg/sglang:v0.5.19-cu130@sha256:d6e7288627be8b02be88e4bba38e73f6d50e2826869f753c13a4c4385ab3eda9。
**基线:**2026-08-16 · lmsysorg/sglang:nightly-dev-cu13-20260805-211ee642
平均延迟 · 来源: API 1, API 2, API 3;数值及异常说明见上表。

Move glm5.2-fp4-gb300-dynamo-sglang-agentic-disagg from the 2026-08-05 dev
nightly lmsysorg/sglang:nightly-dev-cu13-20260805-211ee642 to the
digest-pinned v0.5.19-cu130 release and pair it with the Dynamo
1.5.0.dev20260910 wheel, which follows SGLang's config-parser module move
and ServerArgs resolution change. Model, topology, speculation, workload,
points and evals are unchanged.

将 glm5.2-fp4-gb300-dynamo-sglang-agentic-disagg 从 2026-08-05 的开发夜间镜像
lmsysorg/sglang:nightly-dev-cu13-20260805-211ee642 更新为按摘要固定的
v0.5.19-cu130 正式版镜像,并搭配 Dynamo 1.5.0.dev20260910 wheel(跟进 SGLang
配置解析模块迁移与 ServerArgs 解析变更)。模型、拓扑、投机解码、负载、测点与
评测均保持不变。

Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
@Klaud-Cold

Copy link
Copy Markdown
Collaborator Author

Baseline: 2026-08-16 · lmsysorg/sglang:nightly-dev-cu13-20260805-211ee642

Mean latency

Point Total tok/s/GPU ↑ Output tok/s/GPU ↑ TTFT ms ↓ TPOT ms ↓
AgentX c48 PTP4x1/DTP4x2 aa1d55 N/A N/A N/A N/A
AgentX c48 PTP4x1/DTP4x4 e7eb7f N/A N/A N/A N/A
AgentX c45 PTP4x1/DTP4x6 de72ee N/A N/A N/A N/A
AgentX c128 PTP8x2/DTP16x1 8f3efc N/A N/A N/A N/A
AgentX c192 PTP8x2/DTP16x1 404052 N/A N/A N/A N/A

Note: All rows: unavailable.

Eval Score ↑ Samples
gsm8k/em_strict · c48 95.15% 1,319
gsm8k/em_strict · c48 95.45% 1,319
gsm8k/em_strict · c45 95.3% 1,319
gsm8k/em_strict · c128 94.01% 1,319
gsm8k/em_strict · c192 94.47% 1,319
中文

**基线:**2026-08-16 · lmsysorg/sglang:nightly-dev-cu13-20260805-211ee642;数值及异常说明见表格。

@github-actions

Copy link
Copy Markdown
Contributor

Thanks for the contribution! Please reach out to respective companies' CODEOWNER to fill in the latest PR_REVIEW_CHECKLIST.md before pinging core maintainer on Slack for review. In order for the signoff PR check bot to trigger, you must follow the PR_REVIEW_CHECKLIST.md template correctly, including the phrase As a PR reviewer and CODEOWNER, I have reviewed this and have.

For PR verification, add the full-sweep-fail-fast label (strongly recommended) to this PR — the benchmark sweep only runs on labeled PRs. Use full-sweep-enabled only if you need matrix jobs to keep running past a failure.

PR authors are responsible for ensuring that after merging, all GitHub Action jobs fully pass. A lot of the time, failures are just flakes and simply re-running the failed jobs will fix it. See GitHub's docs on re-running failed jobs


感谢你的贡献!请联系相应公司的 CODEOWNER 填写最新的 PR_REVIEW_CHECKLIST.md,然后再在 Slack 上联系核心维护者进行审阅。为了触发 signoff PR 检查机器人,你必须正确遵循 PR_REVIEW_CHECKLIST.md 模板,包括保留英文语句 As a PR reviewer and CODEOWNER, I have reviewed this and have。

如需进行 PR 验证,请为此 PR 添加 full-sweep-fail-fast 标签(强烈推荐)— 基准测试 sweep 仅在带有标签的 PR 上运行。仅当需要矩阵任务在失败后继续运行时才使用 full-sweep-enabled。

PR 作者有责任确保合并后所有 GitHub Action 任务完全通过。 很多时候失败只是偶发抖动(flake),重新运行失败的任务即可解决。参见 GitHub 关于重新运行失败任务的文档

@Klaud-Cold

Klaud-Cold commented Sep 11, 2026 •

Copy link
Copy Markdown
Collaborator Author

Initial attempt · Deferred · Run 34647418420 / attempt 1 · 2026-09-12 00:11 UTC
lmsysorg/sglang:v0.5.19-cu130@sha256:d6e7288627be8b02be88e4bba38e73f6d50e2826869f753c13a4c4385ab3eda9 · 5d2a8832c20a · Mean latency
Change: Move from the 2026-08-05 dev nightly to the digest-pinned v0.5.19 release (compare 211ee642...0bcd8223, 1,509 commits) and swap the Dynamo source pin 71eb001e for the 1.5.0.dev20260910 wheel: 71eb001e hard-imports sglang.srt.server_args_config_parser, moved under utils by sglang #36681 and fixed in Dynamo #14054; Dynamo #14234 follows the ServerArgs change sglang #36972. All recipe flags and SGLANG_* variables still resolve.

Point Output tok/s/GPU ↑ TTFT ms ↓ TPOT ms ↓
AgentX c48 PTP4x1/DTP4x2 22017e N/A N/A N/A
AgentX c48 PTP4x1/DTP4x4 a2b4c3 N/A N/A N/A
AgentX c45 PTP4x1/DTP4x6 235a04 N/A N/A N/A
AgentX c128 PTP8x2/DTP16x1 dfc185 N/A N/A N/A
AgentX c192 PTP8x2/DTP16x1 eb33a2 N/A N/A N/A

Note: AgentX c48 PTP4x1/DTP4x2 22017e: failed.
Note: All rows: request errors unavailable.
Note: All rows: Δ N/A: no matched baseline.
Note: AgentX c48 PTP4x1/DTP4x4 a2b4c3, AgentX c45 PTP4x1/DTP4x6 235a04, AgentX c128 PTP8x2/DTP16x1 dfc185, AgentX c192 PTP8x2/DTP16x1 eb33a2: cancelled.

Next: Capacity deferral: release the candidate so a later autosweep retries this head once gb300-nv has idle nodes.

中文

初次尝试 · 已延期 · Run 34647418420 / attempt 1 · 2026-09-12 00:11 UTC
lmsysorg/sglang:v0.5.19-cu130@sha256:d6e7288627be8b02be88e4bba38e73f6d50e2826869f753c13a4c4385ab3eda9 · 5d2a8832c20a · 平均延迟
**变更:*将镜像从 2026-08-05 开发夜间版更新为按摘要固定的 v0.5.19 正式版(211ee642...0bcd8223,共 1,509 次提交),并把 Dynamo 源码固定 71eb001e 替换为 1.5.0.dev20260910 wheel:71eb001e 直接导入 sglang.srt.server_args_config_parser,sglang #36681 已将其移至 utils(Dynamo #14054 修复),Dynamo #14234 跟进 ServerArgs 变更(sglang #36972)。配方中的所有参数与 SGLANG_ 环境变量在 v0.5.19 中均仍有效。实测数值及异常说明见上表。
**下一步:**容量推迟:释放候选,待 gb300-nv 有空闲节点后由后续自动扫描重试此提交。

@Klaud-Cold

Copy link
Copy Markdown
Collaborator Author

capacity-deferred · Cleanup pending. Stop and confirm owned runs before closing.

中文

capacity-deferred · 清理待完成。先停止并确认自有运行结束,再关闭 PR。

@Klaud-Cold Klaud-Cold closed this Sep 12, 2026
@Klaud-Cold
Klaud-Cold deleted the klaud/auto-68551d95238169ff-f7a6259862406d3d branch September 12, 2026 00:13
@Klaud-Cold

Copy link
Copy Markdown
Collaborator Author

capacity-deferred · Repairs: 0 · Runs: 34647418420
All owned runs ended. PR closed; branch deleted for retry.

中文

capacity-deferred · 修复次数:0 · 运行:34647418420
所有自有运行均已结束。PR 已关闭;分支已删除,可重新尝试。

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

Status: Done

Development

Successfully merging this pull request may close these issues.

1 participant