Skip to content

[Klaud Cold] Update DSv4 FP4 B200 Dynamo-SGLang AgentX disagg image to SGLang nightly-dev-20260929-79cafec0 / [Klaud Cold] 将 DSv4 FP4 B200 Dynamo-SGLang AgentX 分离式镜像更新为 SGLang nightly-dev-20260929-79cafec0 - #3924

Closed
Klaud-Cold wants to merge 1 commit into
mainfrom
klaud/auto-1a5ea7133ab99854-3af5706b64e41f45

Conversation

@Klaud-Cold

@Klaud-Cold Klaud-Cold commented Oct 12, 2026 •

Copy link
Copy Markdown
Collaborator

Goal: Update SGLang image from lmsysorg/sglang:nightly-dev-20260916-c9a8fba9 to lmsysorg/sglang:nightly-dev-20260929-79cafec0@sha256:0f075735a6bf913a7cc1cd7ece4f526ae8af70fc5b88fdc02d9efe92a61cf3ae.
Baseline: 2026-09-22 · lmsysorg/sglang:nightly-dev-20260916-c9a8fba9
Mean latency · Sources: API 1, API 2, API 3

Point Total tok/s/GPU ↑ Output tok/s/GPU ↑ TTFT ms ↓ TPOT ms ↓
AgentX c64 PTP8x1/DTP8x1 5b3e6b 25,134.99 181.41 2,358.22 7.32
AgentX c128 PTP8x1/DTP8x1 78ff06 38,023.26 305.47 4,445.61 8.47
AgentX c256 PTP8x2/DTP8x1 d5c692 47,447.77 345.79 6,016.56 11.22
Eval Score ↑ Samples
gsm8k/em_strict · c64 97.65% 1,319
gsm8k/em_strict · c128 97.57% 1,319
gsm8k/em_strict · c256 97.57% 1,319
中文

**目标:**将 SGLang 镜像从 lmsysorg/sglang:nightly-dev-20260916-c9a8fba9 更新为 lmsysorg/sglang:nightly-dev-20260929-79cafec0@sha256:0f075735a6bf913a7cc1cd7ece4f526ae8af70fc5b88fdc02d9efe92a61cf3ae。
**基线:**2026-09-22 · lmsysorg/sglang:nightly-dev-20260916-c9a8fba9
平均延迟 · 来源: API 1, API 2, API 3;数值及异常说明见上表。

…ghtly 20260929

Pin lmsysorg/sglang:nightly-dev-20260929-79cafec0 by digest in the master
config and the recipe identity. This is the newest nightly before SGLang
deprecated --enable-dp-attention, which the pinned Dynamo wheel still reads.

将 DSv4 B200 Dynamo-SGLang AgentX 分离式配置更新至 SGLang nightly
20260929-79cafec0(按 digest 固定)。这是 SGLang 弃用 --enable-dp-attention
之前的最新 nightly,当前固定的 Dynamo wheel 仍依赖该参数。

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
@github-actions

Copy link
Copy Markdown
Contributor

Thanks for the contribution!

  • Review: If this PR changes files owned by someone other than a repository admin or @SemiAnalysisAI/core, ask one eligible CODEOWNER to complete the latest PR_REVIEW_CHECKLIST.md before contacting a core maintainer on Slack. Follow the template exactly, including As a PR reviewer and CODEOWNER, I have reviewed this and have, so sign-off verification triggers.
  • PR verification: Sweeps run only when the PR appends an inferencex-e2e/perf-changelog.yaml entry and carries exactly one primary label: full-sweep-fail-fast (strongly recommended; canary plus per-matrix fail-fast), full-sweep-enabled (canary; matrix jobs continue after a failure), or non-canary-full-sweep-enabled (no canary or fail-fast). The modifiers all-evals, evals-only, and agentx-fast require a primary label. On fork PRs, a maintainer applies the label. See sweep labels and reuse.
  • After merging: PR authors must ensure all GitHub Actions jobs pass. Transient failures often pass on rerun; see how to rerun failed jobs.
中文

感谢你的贡献!

  • **审阅:**如果 PR 修改的文件归属于仓库管理员及 @SemiAnalysisAI/core 之外的 CODEOWNER,请先联系一位有资格的 CODEOWNER 填写最新的 PR_REVIEW_CHECKLIST.md,再通过 Slack 联系核心维护者。必须严格遵循模板,并保留 As a PR reviewer and CODEOWNER, I have reviewed this and have,才能触发签核验证。
  • **PR 验证:**只有当 PR 在 inferencex-e2e/perf-changelog.yaml 末尾追加了条目,并且恰好带有一个主标签时,才会运行扫描:full-sweep-fail-fast(强烈推荐;canary 加逐矩阵 fail-fast)、full-sweep-enabled(有 canary;矩阵任务在失败后继续运行)或 non-canary-full-sweep-enabled(无 canary,也无 fail-fast)。修饰标签 all-evals、evals-only 和 agentx-fast 必须与主标签一起使用。fork PR 的标签由维护者添加。参见扫描标签与复用。
  • **合并后:**PR 作者必须确保所有 GitHub Actions 任务通过。临时性失败通常可以通过重新运行恢复;参见重新运行失败任务的说明。

@Klaud-Cold

Klaud-Cold commented Oct 12, 2026 •

Copy link
Copy Markdown
Collaborator Author

Initial attempt · Failed · Run 38216173644 / attempt 1 · 2026-10-12 07:11 UTC
lmsysorg/sglang:nightly-dev-20260929-79cafec0@sha256:0f075735a6bf913a7cc1cd7ece4f526ae8af70fc5b88fdc02d9efe92a61cf3ae · 4f00011e81e6
Change: Image-only bump to 79cafec0 (image labels confirm this commit), the newest nightly before #41818 deprecated --enable-dp-attention; the pinned Dynamo 1.5.0.dev20260914 only gained attn_dp_size support in dynamo#16005. All recipe flags and Dynamo's SGLang imports still exist; SGLANG_OPT_SWA_SPLIT_LEAF_ON_INSERT is now a no-op because #40313 built leaf splitting into the unified SWA cache.

Next: Stop: the mandated smoke path cannot generate this multi-node AgentX family until the shared generator/schema mismatch is fixed; image compatibility remains untested.

中文

初次尝试 · 失败 · Run 38216173644 / attempt 1 · 2026-10-12 07:11 UTC
lmsysorg/sglang:nightly-dev-20260929-79cafec0@sha256:0f075735a6bf913a7cc1cd7ece4f526ae8af70fc5b88fdc02d9efe92a61cf3ae · 4f00011e81e6
**变更:**仅更新镜像至 79cafec0(镜像标签确认该提交),这是 SGLang #41818 弃用 --enable-dp-attention 之前的最新 nightly;当前固定的 Dynamo 1.5.0.dev20260914 直到 dynamo#16005 才支持 attn_dp_size。配方中的所有参数以及 Dynamo 使用的 SGLang 导入均仍存在;由于 #40313 已将叶节点拆分内置到统一 SWA 缓存中,SGLANG_OPT_SWA_SPLIT_LEAF_ON_INSERT 现已不起作用。实测数值及异常说明见上表。
**下一步:**停止:在共享生成器与 schema 不一致的问题修复之前,规定的 smoke 路径无法为该多节点 AgentX 配置族生成矩阵;镜像兼容性尚未验证。

@Klaud-Cold

Copy link
Copy Markdown
Collaborator Author

readiness-blocked · Cleanup pending. Stop and confirm owned runs before closing.

中文

readiness-blocked · 清理待完成。先停止并确认自有运行结束,再关闭 PR。

@Klaud-Cold Klaud-Cold closed this Oct 12, 2026
@Klaud-Cold
Klaud-Cold deleted the klaud/auto-1a5ea7133ab99854-3af5706b64e41f45 branch October 12, 2026 07:11
@Klaud-Cold

Copy link
Copy Markdown
Collaborator Author

readiness-blocked · Repairs: 0 · Runs: 38216173644
All owned runs ended. PR closed; branch deleted for retry.

中文

readiness-blocked · 修复次数:0 · 运行:38216173644
所有自有运行均已结束。PR 已关闭;分支已删除,可重新尝试。

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

Status: Done

Development

Successfully merging this pull request may close these issues.

1 participant