Repository navigation
[Klaud Cold] Update DeepSeek-V4-Pro FP4 B200 vLLM AgentX MTP image to nightly-83c078d9 / [Klaud Cold] 将 DeepSeek-V4-Pro FP4 B200 vLLM AgentX MTP 镜像更新至 nightly-83c078d9 - #4457
Conversation
Move dsv4-fp4-b200-vllm-agentic-mtp from the DSV4 dev build nightly-dev-x86_64-cu13.0.1-20ebb28 to upstream vLLM nightly 83c078d9, pinned by digest. Upstream names the DeepSeek-V4 MegaMoE backend deep_gemm_mega_moe and has no VLLM_DSV4_MEGA_FP8_COMBINE, so the DEP8 recipe uses that backend and drops the env var. 将 dsv4-fp4-b200-vllm-agentic-mtp 从 DSV4 开发构建 nightly-dev-x86_64-cu13.0.1-20ebb28 更新为上游 vLLM nightly 83c078d9, 并按 digest 固定。上游的 DeepSeek-V4 MegaMoE 后端名为 deep_gemm_mega_moe,且不存在 VLLM_DSV4_MEGA_FP8_COMBINE,因此 DEP8 配方改用该后端并移除该环境变量。 Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
|
Thanks for the contribution!
中文感谢你的贡献!
|
|
Initial attempt · Failed · Run 40048229064 / attempt 1 · 2026-10-24 01:51 UTC Next: Repair 1: lower the DEP8 kv-cache-memory-bytes by 4 GiB to restore the activation headroom lost to the larger upstream graph pools and weights, then rerun smoke. 中文初次尝试 · 失败 · Run 40048229064 / attempt 1 · 2026-10-24 01:51 UTC |
Upstream nightly 83c078d9 uses about 3 GiB more CUDA graph memory and 0.4 GiB more weight memory per DEP8 rank, so the fixed KV pool left too little headroom and DEP8 c96 hit OOM in the sparse indexer logits. 上游 nightly 83c078d9 每个 DEP8 rank 的 CUDA graph 内存多约 3 GiB、 权重内存多 0.4 GiB,固定 KV 池留下的余量不足,DEP8 c96 在稀疏索引 logits 分配时发生 OOM,因此将 DEP8 KV 缓存降低 4 GiB。 Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
|
Repair 1/5 · Passed · Run 40051674447 / attempt 1 · 2026-10-24 06:11 UTC
Note: All rows: Δ N/A: no matched baseline.
Next: Append the perf-changelog entry and run the full sweep with full-sweep-fail-fast. 中文修复 1/5 · 已通过 · Run 40051674447 / attempt 1 · 2026-10-24 06:11 UTC |
合并 main 分支。 Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
新增 dsv4 B200 vLLM AgentX 镜像更新的 perf-changelog 条目。 Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
|
resumed · The session ended before finishing; session 2 continues it in a new run of its planner. 中文resumed · 会话未完成即已结束;第 2 个会话将在其规划运行的新运行中继续。 |
|
Final full sweep · Running · Run 40070408546 / attempt 1 · 2026-10-24 06:30 UTC Next: Wait for the full-sweep-fail-fast sweep to finish, then verify every point and eval artifact. 中文最终完整 sweep · 运行中 · Run 40070408546 / attempt 1 · 2026-10-24 06:30 UTC |
|
View unofficial run (performance): https://inferencex.semianalysis.com/inference?unofficialRun=40101218191 View unofficial run (accuracy): https://inferencex.semianalysis.com/evaluation?unofficialRun=40101218191 |
|
Final full sweep · Queued · Run 40070408546 / attempt 2 · 2026-10-24 07:20 UTC Next: Wait for the full-sweep-fail-fast sweep to finish, then verify every point and eval artifact. 中文最终完整 sweep · 排队中 · Run 40070408546 / attempt 2 · 2026-10-24 07:20 UTC |
|
Final full sweep · Passed · Run 40070408546 / attempt 3 · 2026-10-24 14:07 UTC
Note: AgentX c16 TP8 EP1 eb2826, AgentX c64 TP8 EP8 658947, AgentX c160 TP8 EP8 a1f501: 1 request error.
Next: Merge main, keep the dsv4-fp4-b200-vllm-agentic-mtp perf-changelog entry at the physical tail, and rerun the final full sweep on the merged head. 中文最终完整 sweep · 已通过 · Run 40070408546 / attempt 3 · 2026-10-24 14:07 UTC |
|
resumed · The session ended before finishing; session 3 continues it in a new run of its planner. 中文resumed · 会话未完成即已结束;第 3 个会话将在其规划运行的新运行中继续。 |
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
|
Final full sweep · Queued · Run 40101218191 / attempt 1 · 2026-10-24 14:10 UTC
Note: All rows: pending. Next: Wait for the full-sweep-fail-fast sweep on the merged head to finish, then verify every point and eval artifact. 中文最终完整 sweep · 排队中 · Run 40101218191 / attempt 1 · 2026-10-24 14:10 UTC |
|
Final full sweep · Passed · Run 40101218191 / attempt 2 · 2026-10-24 19:48 UTC
Note: AgentX c16 TP8 EP1 eb2826, AgentX c64 TP8 EP8 658947, AgentX c96 TP8 EP8 a5e86a, AgentX c160 TP8 EP8 a1f501: 1 request error.
Next: Mark ready for maintainer review. 中文最终完整 sweep · 已通过 · Run 40101218191 / attempt 2 · 2026-10-24 19:48 UTC |
|
resumed · The session ended before finishing; session 4 continues it in a new run of its planner. 中文resumed · 会话未完成即已结束;第 4 个会话将在其规划运行的新运行中继续。 |
|
validated · Repairs: 1 · Runs: 40048229064, 40051674447, 40069357943, 40070408546, 40101197357, 40101218191 中文validated · 修复次数:1 · 运行:40048229064, 40051674447, 40069357943, 40070408546, 40101197357, 40101218191 |
|
Claude finished @Klaud-Cold's task in 20s —— View job LGTM - no blocking issues found What I checked
|
|
/use 40101218191 |
|
@Klaud-Cold staged run 40101218191. This run remains available across future |
|
requeued · Open for over 5 days while the published baseline of this family moved to a newer image. Closed with 中文requeued · 本 PR 已开放超过 5 天,而该配置族已发布的基线已更新为更新的镜像。已关闭并标记 |
Goal: Update vLLM image from vllm/vllm-openai:nightly-dev-x86_64-cu13.0.1-20ebb28 to vllm/vllm-openai:nightly-83c078d955cd6e0c63d3b12abe669c8de936a370.
Baseline: 2026-10-21 ·
vllm/vllm-openai:nightly-dev-x86_64-cu13.0.1-20ebb28@sha256:dfdee3dbba3d8d30554d90f723a3a18dac562f8442f2c2e8f81804acd1ec673fMean latency · Sources: API 1, API 2, API 3, API 4
Stop: Close this PR at any time to stop this candidate now; Klaud cancels its runs and deletes its branch.
中文
**目标:**将 vLLM 镜像从 vllm/vllm-openai:nightly-dev-x86_64-cu13.0.1-20ebb28 更新至 vllm/vllm-openai:nightly-83c078d955cd6e0c63d3b12abe669c8de936a370。
**基线:**2026-10-21 ·
vllm/vllm-openai:nightly-dev-x86_64-cu13.0.1-20ebb28@sha256:dfdee3dbba3d8d30554d90f723a3a18dac562f8442f2c2e8f81804acd1ec673f平均延迟 · 来源: API 1, API 2, API 3, API 4;数值及异常说明见上表。
**停止:**随时关闭此 PR 即可立即停止该候选:Klaud 会取消其运行并删除其分支。