Skip to content

[Klaud Cold] Update qwen3.5-fp8-b300-dynamo-sglang-agentic-disagg SGLang image to nightly-dev-cu13-20260923-06008c17 / 将 qwen3.5-fp8-b300-dynamo-sglang-agentic-disagg 的 SGLang 镜像更新至 nightly-dev-cu13-20260923-06008c17 - #3384

Closed
Klaud-Cold wants to merge 1 commit into
mainfrom
klaud/auto-3a7743c5a4d1dde4-abb39e882feee984

Conversation

@Klaud-Cold

@Klaud-Cold Klaud-Cold commented Sep 23, 2026 •

Copy link
Copy Markdown
Collaborator

Goal: Update SGLang image from lmsysorg/sglang:nightly-dev-cu13-20260918-20518d85 to lmsysorg/sglang:nightly-dev-cu13-20260923-06008c17@sha256:5921361fcf358cdde4df1968c941c14157f418613b099ad7f3e5aeed6427ae15.
Baseline: 2026-09-21 · lmsysorg/sglang:nightly-dev-cu13-20260918-20518d85
Mean latency · Sources: API 1, API 2, API 3, API 4

Point Total tok/s/GPU ↑ Output tok/s/GPU ↑ TTFT ms ↓ TPOT ms ↓
AgentX c4 PTP4x1/DTP4x1 2a653d 3,453.74 37.52 393.39 2.28
AgentX c12 PTP4x1/DTP4x1 66532b 3,699.77 33.46 26,161.95 16.25
AgentX c24 PTP4x1/DTP4x1 5010d8 17,582.7 147.54 619.44 3.39
AgentX c32 PTP2x1/DTP2x1 cabbcf 38,693.69 342.82 1,370.92 6
AgentX c32 PTP4x1/DTP4x1 04656f 20,623.98 184.41 708.11 3.83
AgentX c40 PTP2x1/DTP2x1 cef85a 44,703.25 423.68 1,465.97 7.26
AgentX c44 PTP2x1/DTP2x1 4744bc 46,713.82 470.17 1,893.85 7.9
AgentX c48 PTP2x1/DTP2x1 f3b1b5 5,466.51 45.89 228,254.34 57.98
AgentX c56 PTP2x1/DTP2x1 b4f7f5 57,140.43 595.62 2,679.55 9.82
Eval Score ↑ Samples
gsm8k/em_strict · c4 PTP4x1/DTP4x1 97.73% 1,319
gsm8k/em_strict · c12 PTP4x1/DTP4x1 97.42% 1,319
gsm8k/em_strict · c24 PTP4x1/DTP4x1 97.73% 1,319
gsm8k/em_strict · c32 PTP2x1/DTP2x1 PEP2/DEP2 97.57% 1,319
gsm8k/em_strict · c32 PTP4x1/DTP4x1 PEP4/DEP1 97.95% 1,319
gsm8k/em_strict · c40 PTP2x1/DTP2x1 PEP2/DEP2 97.8% 1,319
gsm8k/em_strict · c44 PTP2x1/DTP2x1 PEP2/DEP2 97.73% 1,319
gsm8k/em_strict · c48 PTP2x1/DTP2x1 PEP2/DEP2 97.8% 1,319
gsm8k/em_strict · c56 PTP2x1/DTP2x1 PEP2/DEP2 97.73% 1,319
中文

**目标:**将 SGLang 镜像从 lmsysorg/sglang:nightly-dev-cu13-20260918-20518d85 更新为 lmsysorg/sglang:nightly-dev-cu13-20260923-06008c17@sha256:5921361fcf358cdde4df1968c941c14157f418613b099ad7f3e5aeed6427ae15。
**基线:**2026-09-21 · lmsysorg/sglang:nightly-dev-cu13-20260918-20518d85
平均延迟 · 来源: API 1, API 2, API 3, API 4;数值及异常说明见上表。

…image to nightly-dev-cu13-20260923-06008c17

Pin lmsysorg/sglang:nightly-dev-cu13-20260923-06008c17 by its multi-arch
index digest in the master config and in the nine B300 FP8 AgentX 1P1D
recipes (model.container and identity.container.image).

将 qwen3.5-fp8-b300-dynamo-sglang-agentic-disagg 的 SGLang 镜像更新为
nightly-dev-cu13-20260923-06008c17,并在主配置与九个 B300 FP8 AgentX 1P1D
配方(model.container 与 identity.container.image)中按索引摘要固定。

Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
@github-actions

Copy link
Copy Markdown
Contributor

Thanks for the contribution!

  • Review: If this PR changes files owned by someone other than a repository admin or @SemiAnalysisAI/core, ask one eligible CODEOWNER to complete the latest PR_REVIEW_CHECKLIST.md before contacting a core maintainer on Slack. Follow the template exactly, including As a PR reviewer and CODEOWNER, I have reviewed this and have, so sign-off verification triggers.
  • PR verification: Sweeps only run on labeled PRs. Add full-sweep-fail-fast (strongly recommended); use full-sweep-enabled only when matrix jobs should continue after a failure.
  • After merging: PR authors must ensure all GitHub Actions jobs pass. Transient failures often pass on rerun; see how to rerun failed jobs.
中文

感谢你的贡献!

  • **审阅:**如果 PR 修改的文件归属于仓库管理员及 @SemiAnalysisAI/core 之外的 CODEOWNER,请先联系一位有资格的 CODEOWNER 填写最新的 PR_REVIEW_CHECKLIST.md,再通过 Slack 联系核心维护者。必须严格遵循模板,并保留 As a PR reviewer and CODEOWNER, I have reviewed this and have,才能触发签核验证。
  • **PR 验证:**扫描仅在带有标签的 PR 上运行。强烈建议添加 full-sweep-fail-fast;仅当需要矩阵任务在失败后继续运行时才使用 full-sweep-enabled。
  • **合并后:**PR 作者必须确保所有 GitHub Actions 任务通过。临时性失败通常可以通过重新运行恢复;参见重新运行失败任务的说明。

@Klaud-Cold

Copy link
Copy Markdown
Collaborator Author

Initial attempt · Failed · Run 35864347695 / attempt 1 · 2026-09-23 13:10 UTC
lmsysorg/sglang:nightly-dev-cu13-20260923-06008c17@sha256:5921361fcf358cdde4df1968c941c14157f418613b099ad7f3e5aeed6427ae15 · 7cb57ed93f83 · Mean latency
Change: Pin the lmsysorg/sglang cu13 nightly from 20260918-20518d85 to 20260923-06008c17 by index digest (commit, 310 upstream commits) in the master config and nine 1P1D recipes, keeping Dynamo 805a77f0; Dockerfile pins are unchanged (only xgrammar 0.2.1 to 0.2.7 moved), every recipe flag still parses, and upstream removed the SWA/Mamba radix caches (#40313) and HiRadixCache (#40787) and enabled HiCache TMA transfers (#40278).

Point Output tok/s/GPU ↑ TTFT ms ↓ TPOT ms ↓
AgentX c4 PTP4x1/DTP4x1 2a653d N/A N/A N/A
AgentX c12 PTP4x1/DTP4x1 66532b N/A N/A N/A
AgentX c24 PTP4x1/DTP4x1 5010d8 N/A N/A N/A
AgentX c32 PTP4x1/DTP4x1 04656f N/A N/A N/A
AgentX c32 PTP2x1/DTP2x1 cabbcf N/A N/A N/A
AgentX c40 PTP2x1/DTP2x1 cef85a N/A N/A N/A
AgentX c44 PTP2x1/DTP2x1 4744bc N/A N/A N/A
AgentX c48 PTP2x1/DTP2x1 f3b1b5 N/A N/A N/A
AgentX c56 PTP2x1/DTP2x1 b4f7f5 N/A N/A N/A

Note: All rows: failed.
Note: All rows: request errors unavailable.
Note: All rows: Δ N/A: point unavailable.

Next: Stop as readiness-blocked: the shared smoke generator cannot emit a schema-valid multi-node AgentX matrix on main, which Klaud may not edit; retry after the generator or schema is fixed.

中文

初次尝试 · 失败 · Run 35864347695 / attempt 1 · 2026-09-23 13:10 UTC
lmsysorg/sglang:nightly-dev-cu13-20260923-06008c17@sha256:5921361fcf358cdde4df1968c941c14157f418613b099ad7f3e5aeed6427ae15 · 7cb57ed93f83 · 平均延迟
**变更:**将 lmsysorg/sglang cu13 nightly 从 20260918-20518d85 按索引摘要固定至 20260923-06008c17(上游 310 个提交),覆盖主配置与九个 1P1D 配方,Dynamo 保持 805a77f0;Dockerfile 依赖固定不变(仅 xgrammar 0.2.1 升至 0.2.7),配方全部参数仍可解析,上游移除了 SWA/Mamba radix cache(#40313)与 HiRadixCache(#40787),并默认启用 HiCache TMA 传输(#40278)。实测数值及异常说明见上表。
**下一步:**以 readiness-blocked 结束:main 上的共享 smoke 生成器无法为多节点 AgentX 生成符合 schema 的矩阵,且 Klaud 不得修改共享代码;待生成器或 schema 修复后重试。

@Klaud-Cold

Copy link
Copy Markdown
Collaborator Author

readiness-blocked · Cleanup pending. Stop and confirm owned runs before closing.

中文

readiness-blocked · 清理待完成。先停止并确认自有运行结束,再关闭 PR。

@Klaud-Cold Klaud-Cold closed this Sep 23, 2026
@Klaud-Cold
Klaud-Cold deleted the klaud/auto-3a7743c5a4d1dde4-abb39e882feee984 branch September 23, 2026 13:11
@Klaud-Cold

Copy link
Copy Markdown
Collaborator Author

readiness-blocked · Repairs: 0 · Runs: 35864347695
All owned runs ended. PR closed; branch deleted for retry.

中文

readiness-blocked · 修复次数:0 · 运行:35864347695
所有自有运行均已结束。PR 已关闭;分支已删除,可重新尝试。

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

Status: Done

Development

Successfully merging this pull request may close these issues.

1 participant