Skip to content

[CI] Only warn on VibeVoice-ASR mixed-length syncs before Transformers 5.23 - #67026

Merged
hmellor merged 2 commits into
vllm-project:mainfrom
hmellor:vibevoice-mixed-lengths-sync
Nov 11, 2026
Merged

hmellor merged 2 commits into
vllm-project:mainfrom
hmellor:vibevoice-mixed-lengths-sync

Conversation

@hmellor

@hmellor hmellor commented Nov 11, 2026 •

Copy link
Copy Markdown
Member

Overview

Fix test_transformers_audio_mixed_lengths failing on main since #65735 (build 101707): on Transformers < 5.23 the test runs with VLLM_GPU_SYNC_CHECK=warn instead of the CI image's error.

Claims

Validation

B200, Transformers 5.22.0, VLLM_GPU_SYNC_CHECK=error (as in the CI image):

test_transformers_audio_mixed_lengths
main Failed: RuntimeError: GPU<->CPU sync detected at modeling_vibevoice_asr.py:386
This PR Passed
VLLM_GPU_SYNC_CHECK=error pytest tests/models/multimodal/generation/test_transformers_audio.py::test_transformers_audio_mixed_lengths

The FlashInfer JIT doesn't build with the CUDA toolkit on that host, so both runs used VLLM_USE_FLASHINFER_SAMPLER=0 and Triton attention. Neither setting touches the audio encoder, which is where the sync happens.


Pull Request Checklist
  • I used vLLM's /pr-checklist skill. (Mandatory for agents, optional for humans).

  • AI assistance was used during the creation of this PR.

  • Design Fit: Minimizes impact on core components, reuses existing functionality, and justifies added complexity.

  • Testing and Validation: Validates the change and ensures any added tests are meaningful and reliable, with CI coverage or documented CI resource constraints and validation performed outside CI.

  • Code Quality and Style: Keeps code and comments clear and concise, and updates relevant documentation and examples.

  • Pull Request Contents: Includes a brief summary and relevant links, supports claims with evidence, explains root causes and implementation trade-offs, and follows the contributing guide.

🤖 Generated with Claude Code

…s 5.23

huggingface/transformers#50417 removes the sync but is unreleased.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
@mergify mergify Bot added the multi-modality Related to multi-modality (#4194) label Nov 11, 2026
@hmellor
hmellor marked this pull request as ready for review November 11, 2026 12:33

@claude claude Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Claude Code Review

This pull request is from a fork — automated review is disabled. A repository maintainer can comment @claude review to run a one-time review.

@hmellor

hmellor commented Nov 11, 2026

Copy link
Copy Markdown
Member Author

/ci run

@github-actions

Copy link
Copy Markdown

✅ Triggered Buildkite CI #101805 for commit 003671802252.

ℹ️ This PR is 1 commit behind upstream main. Merged upstream main into this branch as 003671802252 before starting CI. Pull the branch before pushing more changes.

@hmellor
hmellor enabled auto-merge (squash) November 11, 2026 12:34
@github-actions github-actions Bot added the ready ONLY add when PR is ready to merge/full CI is needed label Nov 11, 2026
@hmellor
hmellor merged commit b0fbb3c into vllm-project:main Nov 11, 2026
40 checks passed
@hmellor
hmellor deleted the vibevoice-mixed-lengths-sync branch November 11, 2026 13:12
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

multi-modality Related to multi-modality (#4194) ready ONLY add when PR is ready to merge/full CI is needed

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants