Repository navigation
[CI] Enroll 12 steps in automatic sharding - #68257
Open
Thangnguyenvn98 wants to merge 5 commits into
Open
Thangnguyenvn98 wants to merge 5 commits into
Thangnguyenvn98 wants to merge 5 commits into
Conversation
Contributor
Author
|
/ci run |
|
✅ Triggered Buildkite CI #103643 for commit |
Contributor
Author
Build note: #103643 (
|
| Step | Slowest | Node IDs vs main | Machine |
|---|---|---|---|
shardq-metadata-b200 |
0.7 min | 1 = 1 vs 103629, 0 diff | +0.2 min |
weight-reload-refit |
13.7 min | 83 = 83 vs 103629, 0 diff | -1% |
weight-reload-refit-nightly |
8.3 min | 4 = 4 vs nightly 103594, 0 diff | -1% |
weight-reload-refit-2gpu |
18.4 min | 5 = 5 vs nightly 103594, 0 diff | -3% |
multi-modal-flashinfer-autotuning |
5.8 min | 3 = 3 vs nightly 103594, 0 diff | -5% |
- ShardQ Metadata's one test is skipped on this runner, as on main.
Thangnguyenvn98
force-pushed
the
agent/automatic-shard-new-steps-1117
branch
from
November 18, 2026 04:22
4f9cf81 to
2bea5cd
Compare
Contributor
Author
|
/ci run |
|
✅ Triggered Buildkite CI #103741 for commit ℹ️ This PR is 1 commit behind upstream |
ShardQ Metadata, the three Weight Reload Refit steps and Multimodal FlashInfer Autotuning are new on main and each fits in one job today, so the generator plans one shard for each; they shard on their own when their tests grow. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com> Signed-off-by: Thang Nguyen <thangnguyenvn647@gmail.com>
… E2E TP2, LM Eval ReplaySSM and Rust Frontend Chat Completions Added to main between 11-04 and 11-13 and never enrolled. Each fits in one job today; the AMD mirrors of the four that have one go with them. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com> Signed-off-by: Thang Nguyen <thangnguyenvn647@gmail.com>
…atic sharding Nightly-only, plain pytest on one node; fits in one job today. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com> Signed-off-by: Thang Nguyen <thangnguyenvn647@gmail.com>
Thangnguyenvn98
force-pushed
the
agent/automatic-shard-new-steps-1117
branch
from
November 18, 2026 04:23
0a5b246 to
bb9038b
Compare
Contributor
Author
|
/ci run |
|
✅ Triggered Buildkite CI #103743 for commit |
Runs about 23 minutes as one job on main; planned as 2 shards from main's timings, splitting test_elastic_ep.py by test. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com> Signed-off-by: Thang Nguyen <thangnguyenvn647@gmail.com>
Contributor
Author
|
/ci run |
Draft
4 of 6 tasks
|
✅ Triggered Buildkite CI #103757 for commit ℹ️ This PR is 6 commits behind upstream |
This branch has not been deployed
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Overview
Enrolls twelve steps that have never been enrolled, most added to
.buildkite/test_areas/since the last enrollment sweep, with the AMD mirrors of the four that have one, so they don't stay on the not-enrolled list:Elastic EP Scaling is also in the stale draft #61476, whose other four steps are already enrolled on main; no other open PR enrolls these. Every other NVIDIA job the sharding page lists as not enrolled is in an open PR, runs on several nodes, or has commands that aren't plain pytest (scripts,
torchrun), which the generator can't shard.Claims
Validation
/ci run103643 on the first five (head4f9cf81a21) passed with no retries: same node IDs as main 103629 and nightly 103594, 0 missing, added, changed or duplicated, machine time within noise./ci runon this head, plus a scoped build for any mirror it leaves out: results in a comment.Details
Pull Request Checklist
I used vLLM's
/pr-checklistskill. (Mandatory for agents, optional for humans).AI assistance was used during the creation of this PR.
Design Fit: Minimizes impact on core components, reuses existing functionality, and justifies added complexity.
Testing and Validation: Validates the change and ensures any added tests are meaningful and reliable, with CI coverage or documented CI resource constraints and validation performed outside CI.
Code Quality and Style: Keeps code and comments clear and concise, and updates relevant documentation and examples.
Pull Request Contents: Includes a brief summary and relevant links, supports claims with evidence, explains root causes and implementation trade-offs, and follows the contributing guide.
🤖 Generated with Claude Code