Repository navigation
[Klaud Cold] Update GLM-5.2 FP4 B300 SGLang AgentX MTP image to v0.5.22-cu130 / [Klaud Cold] 将 GLM-5.2 FP4 B300 SGLang AgentX MTP 镜像更新至 v0.5.22-cu130 - #4325
Conversation
Pin lmsysorg/sglang:v0.5.22-cu130 by digest and pass the CUDA graph batch as cuda-graph-max-bs-decode, since v0.5.22 removed the deprecated cuda-graph-max-bs alias. 将 GLM-5.2 B300 FP4 SGLang AgentX MTP 镜像按 digest 固定为 lmsysorg/sglang:v0.5.22-cu130,并改用 cuda-graph-max-bs-decode 传递 CUDA graph 批大小,因为 v0.5.22 移除了已弃用的 cuda-graph-max-bs 别名。 Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
|
Thanks for the contribution!
中文感谢你的贡献!
|
|
Initial attempt · Running · Run 39305481768 / attempt 1 · 2026-10-19 19:49 UTC Next: All 11 smoke points and the c48 GSM8K eval have been running on b300-dsxe for about an hour with no failures; wait for completion. 中文初次尝试 · 运行中 · Run 39305481768 / attempt 1 · 2026-10-19 19:49 UTC |
|
Initial attempt · Queued · Run 39305481768 / attempt 2 · 2026-10-19 20:44 UTC Next: Nine smoke points passed; the scheduler preempted c8, c48 and the c48 GSM8K eval and requeued them as run attempt 2, so wait for that rerun. 中文初次尝试 · 排队中 · Run 39305481768 / attempt 2 · 2026-10-19 20:44 UTC |
|
Initial attempt · Queued · Run 39305481768 / attempt 3 · 2026-10-19 21:49 UTC Next: Nine smoke points passed; the scheduler preempted c8, c48 and the c48 GSM8K eval twice and requeued them as run attempt 3, so wait for that rerun. 中文初次尝试 · 排队中 · Run 39305481768 / attempt 3 · 2026-10-19 21:49 UTC |
|
resumed · The session ended before finishing; session 2 continues it in a new run of its planner. 中文resumed · 会话未完成即已结束;第 2 个会话将在其规划运行的新运行中继续。 |
|
Initial attempt · Running · Run 39305481768 / attempt 4 · 2026-10-20 08:22 UTC
Note: All rows: Δ N/A: dataset/scenario/statistic mismatch.
Next: Ten smoke points and the c48 GSM8K eval passed; the c48 throughput rerun in run attempt 4 started on b300-dsxe after about seven and a half hours queued, so wait for it. 中文初次尝试 · 运行中 · Run 39305481768 / attempt 4 · 2026-10-20 08:22 UTC |
|
resumed · The session ended before finishing; session 3 continues it in a new run of its planner. 中文resumed · 会话未完成即已结束;第 3 个会话将在其规划运行的新运行中继续。 |
|
Initial attempt · Passed · Run 39305481768 / attempt 5 · 2026-10-20 12:30 UTC
Note: All rows: Δ N/A: dataset/scenario/statistic mismatch.
Next: All 11 smoke points and the c48 GSM8K eval passed on b300-dsxe; append the perf-changelog entry and dispatch the full-sweep-fail-fast final sweep. 中文初次尝试 · 已通过 · Run 39305481768 / attempt 5 · 2026-10-20 12:30 UTC |
|
resumed · The session ended before finishing; session 4 continues it in a new run of its planner. 中文resumed · 会话未完成即已结束;第 4 个会话将在其规划运行的新运行中继续。 |
…P v0.5.22-cu130 Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
…1a0f3e-9e6710099ed6010e # Conflicts: # inferencex-e2e/perf-changelog.yaml
|
Final full sweep · Running · Run 39423009783 / attempt 1 · 2026-10-20 13:03 UTC Next: The c48 GSM8K eval passed; all 11 throughput points have been running on b300-dsxe for about 40 minutes, so wait for them. 中文最终完整 sweep · 运行中 · Run 39423009783 / attempt 1 · 2026-10-20 13:03 UTC |
|
View unofficial run (performance): https://inferencex.semianalysis.com/inference?unofficialRun=39423009783 View unofficial run (accuracy): https://inferencex.semianalysis.com/evaluation?unofficialRun=39423009783 |
|
Infrastructure retry 1 · Cancelled · Run 39423009783 / attempt 2 · 2026-10-20 14:34 UTC Next: Stopped because a maintainer closed this PR at 14:32 UTC, which cancelled the queued rerun of the seven remaining final-sweep points; Klaud does not reopen it. 中文基础设施重试 1 · 已取消 · Run 39423009783 / attempt 2 · 2026-10-20 14:34 UTC |
|
aborted · Cleanup pending. Stop and confirm owned runs before closing. 中文aborted · 清理待完成。先停止并确认自有运行结束,再关闭 PR。 |
|
aborted · Repairs: 0 · Runs: 39305481768, 39422947988, 39423009783 中文aborted · 修复次数:0 · 运行:39305481768, 39422947988, 39423009783 |
Goal: Update SGLang image from
lmsysorg/sglang:nightly-dev-cu13-20260901-07c8f729tolmsysorg/sglang:v0.5.22-cu130@sha256:e3a4f06001a29542fc4a8638536d9ffc5eb9c9942b08603c09b19a56eae4a1ae.Baseline: 2026-10-12 ·
lmsysorg/sglang:nightly-dev-cu13-20260901-07c8f729AgentX · TP8/EP1 · Mean latency · Sources: API 1, API 2, API 3
Stop: Add the
klaud-abortlabel at any time to stop this candidate now; Klaud cancels its runs, closes this PR and does not retry it. Remove the label to let the planner pick it up again.中文
**目标:**将 SGLang 镜像从
lmsysorg/sglang:nightly-dev-cu13-20260901-07c8f729更新至lmsysorg/sglang:v0.5.22-cu130@sha256:e3a4f06001a29542fc4a8638536d9ffc5eb9c9942b08603c09b19a56eae4a1ae。**基线:**2026-10-12 ·
lmsysorg/sglang:nightly-dev-cu13-20260901-07c8f729AgentX · TP8/EP1 · 平均延迟 · 来源: API 1, API 2, API 3;数值及异常说明见上表。
**停止:**随时添加
klaud-abort标签即可立即停止该候选:Klaud 会取消其运行、关闭此 PR 且不再重试。移除该标签后,规划器会在下次扫描时重新考虑它。