Repository navigation
[Klaud Cold] Update DSR1 FP8 MI300X SGLang image to v0.5.21-rocm720-mi30x / [Klaud Cold] 将 DSR1 FP8 MI300X SGLang 镜像更新至 v0.5.21-rocm720-mi30x - #4212
Conversation
Pin lmsysorg/sglang:v0.5.21-rocm720-mi30x by digest and rename the removed --cuda-graph-max-bs alias to --cuda-graph-max-bs-decode (sglang#38375). 将 MI300X FP8 SGLang 镜像更新至 v0.5.21-rocm720-mi30x(按 digest 固定), 并将已移除的 --cuda-graph-max-bs 别名改为 --cuda-graph-max-bs-decode(sglang#38375)。 Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
|
Thanks for the contribution!
中文感谢你的贡献!
|
|
Initial attempt · Passed · Run 38964094385 / attempt 1 · 2026-10-16 21:23 UTC
Note: All rows: request errors unavailable.
Note: All rows: Δ N/A: no matched eval baseline. Next: Append the exact-family perf-changelog entry and run the full-sweep-fail-fast sweep against all five unretired 8k/1k baseline points. 中文初次尝试 · 已通过 · Run 38964094385 / attempt 1 · 2026-10-16 21:23 UTC |
…pdate Append the perf-changelog entry for the MI300X FP8 SGLang image update. 为 MI300X FP8 SGLang 镜像更新追加 perf-changelog 条目。 Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
|
Final full sweep · Failed · Run 38969255712 / attempt 1 · 2026-10-16 22:21 UTC Note: 1k/1k c4 TP8 EP1 14b375, 1k/1k c8 TP8 EP1 c5e335, 1k/1k c16 TP8 EP1 a288ec, 1k/1k c32 TP8 EP1 fb7ddf, 1k/1k c64 TP8 EP1 e94574: Single-turn 1k1k retired 2026-07-17 in #2263 after this baseline; excluded from coverage. Next: Rerun the failed and cancelled benchmarks on the same head as an infrastructure retry, reusing the passed c32/c64 evals. 中文最终完整 sweep · 失败 · Run 38969255712 / attempt 1 · 2026-10-16 22:21 UTC |
|
View unofficial run (performance): https://inferencex.semianalysis.com/inference?unofficialRun=38969255712 View unofficial run (accuracy): https://inferencex.semianalysis.com/evaluation?unofficialRun=38969255712 |
|
Infrastructure retry 1 · Failed · Run 38969255712 / attempt 2 · 2026-10-16 22:34 UTC Next: Run the second and last infrastructure retry of the failed and cancelled benchmarks on the same head; the c32/c64 evals stay reused. 中文基础设施重试 1 · 失败 · Run 38969255712 / attempt 2 · 2026-10-16 22:34 UTC |
|
Infrastructure retry 2 · Failed · Run 38969255712 / attempt 3 · 2026-10-16 22:44 UTC Next: Stop as readiness-blocked: MI300X nodes e07-12, e07-31 and e07-40 need complete staged DeepSeek-R1-0528 weights before this image update can be validated. 中文基础设施重试 2 · 失败 · Run 38969255712 / attempt 3 · 2026-10-16 22:44 UTC |
|
readiness-blocked · Cleanup pending. Stop and confirm owned runs before closing. 中文readiness-blocked · 清理待完成。先停止并确认自有运行结束,再关闭 PR。 |
|
readiness-blocked · Repairs: 0 · Runs: 38964094385, 38969177491, 38969255712 中文readiness-blocked · 修复次数:0 · 运行:38964094385, 38969177491, 38969255712 |
Goal: Update SGLang image from lmsysorg/sglang:v0.5.12-rocm700-mi30x to lmsysorg/sglang:v0.5.21-rocm720-mi30x.
Baseline: 2026-05-18 ·
lmsysorg/sglang:v0.5.12-rocm700-mi30xMean latency · Sources: API 1, API 2
Note: 1k/1k c4 TP8 EP1 14b375, 1k/1k c8 TP8 EP1 c5e335, 1k/1k c16 TP8 EP1 a288ec, 1k/1k c32 TP8 EP1 fb7ddf, 1k/1k c64 TP8 EP1 e94574: Single-turn 1k1k retired 2026-07-17 in #2263 after this baseline; excluded from coverage.
Eval: N/A
中文
**目标:**将 SGLang 镜像从 lmsysorg/sglang:v0.5.12-rocm700-mi30x 更新到 lmsysorg/sglang:v0.5.21-rocm720-mi30x。
**基线:**2026-05-18 ·
lmsysorg/sglang:v0.5.12-rocm700-mi30x平均延迟 · 来源: API 1, API 2;数值及异常说明见上表。