Skip to content

[Test] wan2.2-s2v: Add the 2-GPU server accuracy case - #44441

Draft
murthy-l wants to merge 6 commits into
sgl-project:mainfrom
murthy-l:wan2_s2v_accuracy_case
Draft

murthy-l wants to merge 6 commits into
sgl-project:mainfrom
murthy-l:wan2_s2v_accuracy_case

Conversation

@murthy-l

@murthy-l murthy-l commented Oct 15, 2026 •

Copy link
Copy Markdown
Contributor

Adds wan2_2_s2v_14b_2gpu to TWO_GPU_CASES, with two checks the existing t2v/i2v gates cannot express.

The two checks

  • Audio sensitivity (differential). Generate twice at a fixed prompt, seed and conditioning image, swapping only the audio, then require the mouth region to change far more than a static background region. The differential is the point: an absolute motion threshold is satisfied by a model that animates nothing at all, since the existing gates compare a single output against a bound rather than two outputs against each other.
  • Reference fidelity. PSNR/SSIM of the key frames against the conditioning image, so a drifting or collapsed identity fails rather than scoring well on motion alone.

Why it is XPU-gated

The region boxes and bounds exist only in intel_xpu_b60.json. get_audio_sensitivity_thresholds() refuses to guess them for another platform instead of silently running a check nobody calibrated — an uncalibrated region box would pass or fail for reasons unrelated to the model.

The case is therefore appended to TWO_GPU_CASES only under current_platform.is_xpu(). On NVIDIA CI it does not exist, so it needs no estimated_full_test_time_s in perf_baselines/h100.json (there is no H100 measurement to put there); the one side effect is that test_suite_partitioning.py::test_two_gpu_cases_have_h100_full_test_time_estimates fails when the unit suite is run on an XPU host. A dedicated 2-GPU XPU case list (like ONE_GPU_XPU_CASES) would remove that; happy to add it if preferred.

Measured

2 × B60, ulysses 2, dit=layerwise-offload, 4 steps:

metric measured bound
mouth region 24.66 dB —
background region 39.80 dB —
separation 15.14 dB ≥ 6.0 dB
reference PSNR 18+ ≥ 18
reference SSIM 0.60+ ≥ 0.60

The separation clears its bound by 9.1 dB, so the gate is not sitting on its threshold.

Base

⚠️ Stacked on #43279 (the S2V port, 5 commits): until it merges the diff also shows them; only the last commit is new, [Test] wan2.2-s2v: Add the 2-GPU server accuracy case. Rebased onto #43279's head fd32972495 (main 92a6910ef2). No file overlap with #43288, #44427 or #44429, but it needs #44429 at run time: the case's audio_path travels in the /v1/videos request's extra_body, which only #44429 admits for S2V (without it every request is rejected). Merge after #43279 and #44429; independent of #43288 and #44427.

Files

5 files, +315/−0: the threshold JSON, the case registration (gpu_cases.py, testcase_configs.py), the checks (test_server_common.py) and their helpers (test_utils.py).


CI States

Latest PR Test (Base): ❌ Run #42814566879
Latest PR Test (Extra): ❌ Run #42814566535
Latest PR Test (AMD ROCm 10): ❌ Run #42814566436

Tip

Base CI only covers the core cases, and its workload may not exercise your change. Use /rerun-test to run the tests your change touches, or copy this prompt for an agent:

Find the registered tests this PR affects and run them with /rerun-test, following https://github.com/sgl-project/sglang/blob/main/.agents/skills/rerun-test/SKILL.md

@github-actions github-actions Bot added the diffusion SGLang Diffusion label Oct 15, 2026
@murthy-l
murthy-l force-pushed the wan2_s2v_accuracy_case branch from c2dd3a8 to b9fbcbb Compare October 19, 2026 04:35
@murthy-l murthy-l changed the title [Diffusion] Wan2.2-S2V: add the 2-GPU server accuracy case [Test] wan2.2-s2v: Add the 2-GPU server accuracy case Oct 19, 2026
murthy-l and others added 5 commits November 5, 2026 11:04
…oject#21609)

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
…mup_audio

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

diffusion SGLang Diffusion

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant