Skip to content

[Klaud Cold] Update DSv4 FP4 GB300 Dynamo-SGLang AgentX disagg image to v0.5.22-cu130 / [Klaud Cold] 将 DSv4 FP4 GB300 Dynamo-SGLang AgentX 分离式镜像更新至 v0.5.22-cu130 - #4175

Closed
Klaud-Cold wants to merge 2 commits into
mainfrom
klaud/auto-76054d6b0dbb8e62-62cd6fb27cbff374
Closed

Klaud-Cold wants to merge 2 commits into
mainfrom
klaud/auto-76054d6b0dbb8e62-62cd6fb27cbff374

Conversation

@Klaud-Cold

@Klaud-Cold Klaud-Cold commented Oct 16, 2026 •

Copy link
Copy Markdown
Collaborator

Goal: Update SGLang image from lmsysorg/sglang:nightly-dev-cu13-20260916-c9a8fba9 to lmsysorg/sglang:v0.5.22-cu130@sha256:e3a4f06001a29542fc4a8638536d9ffc5eb9c9942b08603c09b19a56eae4a1ae.
Baseline: 2026-10-08 · lmsysorg/sglang:nightly-dev-cu13-20260916-c9a8fba9
Mean latency · Sources: API 1, API 2, API 3

Point Total tok/s/GPU ↑ Output tok/s/GPU ↑ TTFT ms ↓ TPOT ms ↓
AgentX c120 PTP8x1/DTP16x1 602772 26,304.26 205.34 3,806.9 6.63
AgentX c480 PTP8x1/DTP16x1 e9d674 85,649.42 657.39 9,050.56 9.41
AgentX c960 PTP8x2/DTP16x1 37c644 115,825.03 865.59 9,019.85 13.99
AgentX c1440 PTP8x3/DTP16x1 9626f5 123,251.46 922.41 9,516.72 18.41
AgentX c2400 PTP8x4/DTP16x1 c9ea44 127,047.36 965.45 15,838.86 28.38
Eval Score ↑ Samples
gsm8k/em_strict · c480 97.04% 1,319
gsm8k/em_strict · c960 97.42% 1,319
gsm8k/em_strict · c1440 97.19% 1,319
gsm8k/em_strict · c2400 97.42% 1,319
中文

**目标:**将 SGLang 镜像从 lmsysorg/sglang:nightly-dev-cu13-20260916-c9a8fba9 更新到 lmsysorg/sglang:v0.5.22-cu130@sha256:e3a4f06001a29542fc4a8638536d9ffc5eb9c9942b08603c09b19a56eae4a1ae。
**基线:**2026-10-08 · lmsysorg/sglang:nightly-dev-cu13-20260916-c9a8fba9
平均延迟 · 来源: API 1, API 2, API 3;数值及异常说明见上表。

…cu130

Update dsv4-fp4-gb300-dynamo-sglang-agentic-disagg from
lmsysorg/sglang:nightly-dev-cu13-20260916-c9a8fba9 to the digest-pinned
v0.5.22-cu130 release.

将 dsv4-fp4-gb300-dynamo-sglang-agentic-disagg 的镜像从
lmsysorg/sglang:nightly-dev-cu13-20260916-c9a8fba9 更新为按摘要固定的
v0.5.22-cu130 正式版。

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
@github-actions

Copy link
Copy Markdown
Contributor

Thanks for the contribution!

  • Review: If this PR changes files owned by someone other than a repository admin or @SemiAnalysisAI/core, ask one eligible CODEOWNER to complete the latest PR_REVIEW_CHECKLIST.md before contacting a core maintainer on Slack. Follow the template exactly, including As a PR reviewer and CODEOWNER, I have reviewed this and have, so sign-off verification triggers.
  • PR verification: Sweeps run only when the PR appends an inferencex-e2e/perf-changelog.yaml entry and carries exactly one primary label: full-sweep-fail-fast (strongly recommended; canary plus per-matrix fail-fast), full-sweep-enabled (canary; matrix jobs continue after a failure), or non-canary-full-sweep-enabled (no canary or fail-fast). The modifiers all-evals, evals-only, and agentx-fast require a primary label. On fork PRs, a maintainer applies the label. See sweep labels and reuse.
  • After merging: PR authors must ensure all GitHub Actions jobs pass. Transient failures often pass on rerun; see how to rerun failed jobs.
中文

感谢你的贡献!

  • **审阅:**如果 PR 修改的文件归属于仓库管理员及 @SemiAnalysisAI/core 之外的 CODEOWNER,请先联系一位有资格的 CODEOWNER 填写最新的 PR_REVIEW_CHECKLIST.md,再通过 Slack 联系核心维护者。必须严格遵循模板,并保留 As a PR reviewer and CODEOWNER, I have reviewed this and have,才能触发签核验证。
  • **PR 验证:**只有当 PR 在 inferencex-e2e/perf-changelog.yaml 末尾追加了条目,并且恰好带有一个主标签时,才会运行扫描:full-sweep-fail-fast(强烈推荐;canary 加逐矩阵 fail-fast)、full-sweep-enabled(有 canary;矩阵任务在失败后继续运行)或 non-canary-full-sweep-enabled(无 canary,也无 fail-fast)。修饰标签 all-evals、evals-only 和 agentx-fast 必须与主标签一起使用。fork PR 的标签由维护者添加。参见扫描标签与复用。
  • **合并后:**PR 作者必须确保所有 GitHub Actions 任务通过。临时性失败通常可以通过重新运行恢复;参见重新运行失败任务的说明。

@Klaud-Cold

Klaud-Cold commented Oct 16, 2026 •

Copy link
Copy Markdown
Collaborator Author

Initial attempt · Failed · Run 38889114607 / attempt 1 · 2026-10-16 11:28 UTC
lmsysorg/sglang:v0.5.22-cu130@sha256:e3a4f06001a29542fc4a8638536d9ffc5eb9c9942b08603c09b19a56eae4a1ae · 12dbddac599f
Change: Image-only bump to the v0.5.22-cu130 release (built from sglang commit baa9befa, which contains c9a8fba9); all recipe flags exist unchanged in v0.5.22, SGLANG_OPT_SWA_RELEASE_LEAF_LOCK_AFTER_WINDOW is still read as a deprecated alias of SGLANG_OPT_RELEASE_PREFILL_SWA (sgl-project/sglang#42657), and SGLANG_OPT_SWA_SPLIT_LEAF_ON_INSERT only gated the legacy SWA radix cache removed in sgl-project/sglang#40313 since the unified cache always caps the leaf; torch 2.13.0 to 2.14.1, flashinfer 0.6.18 to 0.7.1, sglang-kernel 0.4.7 to 0.4.9, Mooncake 0.3.13 to 0.3.13.post1, and Dynamo wheel compatibility is unverified until smoke.

Next: Repair 1 (mooncake-master readiness timeout raised to 600 s at 06b377e) was not dispatched because gb300-nv failed the capacity check, so this candidate is deferred to a later wave.

中文

初次尝试 · 失败 · Run 38889114607 / attempt 1 · 2026-10-16 11:28 UTC
lmsysorg/sglang:v0.5.22-cu130@sha256:e3a4f06001a29542fc4a8638536d9ffc5eb9c9942b08603c09b19a56eae4a1ae · 12dbddac599f
**变更:**仅更新镜像到 v0.5.22-cu130 正式版(基于包含 c9a8fba9 的 sglang 提交 baa9befa 构建);配方中所有参数在 v0.5.22 中均保持不变,SGLANG_OPT_SWA_RELEASE_LEAF_LOCK_AFTER_WINDOW 仍作为 SGLANG_OPT_RELEASE_PREFILL_SWA 的弃用别名被读取(sgl-project/sglang#42657),SGLANG_OPT_SWA_SPLIT_LEAF_ON_INSERT 只控制已在 sgl-project/sglang#40313 中移除的旧 SWA radix cache,统一缓存始终会截断叶子;torch 2.13.0 升至 2.14.1、flashinfer 0.6.18 升至 0.7.1、sglang-kernel 0.4.7 升至 0.4.9、Mooncake 0.3.13 升至 0.3.13.post1,Dynamo wheel 兼容性需由冒烟测试验证。实测数值及异常说明见上表。
**下一步:**由于 gb300-nv 未通过容量检查,修复 1(在 06b377e 将 mooncake-master 就绪超时提高到 600 秒)未被派发,该候选推迟到后续批次。

The v0.5.22-cu130 container start on the infra node took 132 s, past
srtctl's 120 s default; use the 600 s timeout the decode stores already use.

v0.5.22-cu130 容器在 infra 节点上的启动耗时 132 秒,超过 srtctl 默认的
120 秒;改用 decode store 已在使用的 600 秒超时。

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
@Klaud-Cold

Copy link
Copy Markdown
Collaborator Author

capacity-deferred · Cleanup pending. Stop and confirm owned runs before closing.

中文

capacity-deferred · 清理待完成。先停止并确认自有运行结束,再关闭 PR。

@Klaud-Cold Klaud-Cold closed this Oct 16, 2026
@Klaud-Cold
Klaud-Cold deleted the klaud/auto-76054d6b0dbb8e62-62cd6fb27cbff374 branch October 16, 2026 11:35
@Klaud-Cold

Copy link
Copy Markdown
Collaborator Author

capacity-deferred · Repairs: 0 · Runs: 38889114607
All owned runs ended. PR closed; branch deleted for retry.

中文

capacity-deferred · 修复次数:0 · 运行:38889114607
所有自有运行均已结束。PR 已关闭;分支已删除,可重新尝试。

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

Status: Done

Development

Successfully merging this pull request may close these issues.

1 participant