Skip to content

feat(kvbm): publish complete matching-TP GPU bank groups [D21] - #18039

Closed
yifjiang wants to merge 1 commit into
codex/kv-reuse-d20-fabric-bank-registrationfrom
codex/kv-reuse-d21-complete-rank-groups
Closed

yifjiang wants to merge 1 commit into
codex/kv-reuse-d20-fabric-bank-registrationfrom
codex/kv-reuse-d21-complete-rank-groups

Conversation

@yifjiang

@yifjiang yifjiang commented Nov 4, 2026 •

Copy link
Copy Markdown
Contributor

Summary

One logical row includes all N rank rows; unique devices, complete readiness, strict positive integer N, bounded group metadata and rollback.

Review slice D21 of #16748; part of #16747 and #16746. This draft targets codex/kv-reuse-d20-fabric-bank-registration for a complete incremental review diff of 436 additions plus deletions, including tests, documentation and extraction glue.

Extraction details:

  • Introduce the bounded private descriptor reader before its first use in atomic group construction, plus its symlink test.

Reuse remains experimental and default off. Retained inventory is advisory, complete compatible rank parts must precede readiness, and native operations retain ownership until quiescence. Supported GPU activation also requires the companion KVCR/native slices and the declared deployment profile.

Validation

All configured pre-commit hooks passed for this exact slice on allocated SLURM. Stack-level CPU regression coverage is summarized on D31; each draft still requires its own applicable CI in the Checks tab. Historical combined-head and hardware results retain their original source scope.

@github-actions github-actions Bot added feat backend::vllm Relates to the vllm backend labels Nov 4, 2026
@devin-ai-integration

devin-ai-integration Bot commented Nov 4, 2026 •

Copy link
Copy Markdown
Contributor

✅ Dynamo PR CI passed — run 41941685389 (attempt 2) on a5d4b23bc0

Gate checks: ✅ backend-status-check · ✅ deploy-status-check · ✅ dynamo-status-check

Posted automatically by Devin for run 41941685389. Updated on every full-CI run of this PR.

@yifjiang
yifjiang force-pushed the codex/kv-reuse-d20-fabric-bank-registration branch from a5965f4 to dc723e4 Compare November 4, 2026 08:16
@yifjiang
yifjiang force-pushed the codex/kv-reuse-d21-complete-rank-groups branch 2 times, most recently from 6e8dfba to 8afab87 Compare November 4, 2026 08:28
@yifjiang
yifjiang force-pushed the codex/kv-reuse-d20-fabric-bank-registration branch from dc723e4 to ea735f5 Compare November 4, 2026 08:34
@yifjiang
yifjiang force-pushed the codex/kv-reuse-d21-complete-rank-groups branch from 8afab87 to e1baed0 Compare November 4, 2026 08:34
@yifjiang
yifjiang force-pushed the codex/kv-reuse-d20-fabric-bank-registration branch from ea735f5 to a817ccd Compare November 4, 2026 08:54
@yifjiang
yifjiang force-pushed the codex/kv-reuse-d21-complete-rank-groups branch from e1baed0 to 849007d Compare November 4, 2026 08:54
@yifjiang
yifjiang force-pushed the codex/kv-reuse-d20-fabric-bank-registration branch from a817ccd to bbefbff Compare November 4, 2026 20:39
@yifjiang
yifjiang force-pushed the codex/kv-reuse-d21-complete-rank-groups branch from 849007d to 5fe6b39 Compare November 4, 2026 20:39
@copy-pr-bot

copy-pr-bot Bot commented Nov 4, 2026

Copy link
Copy Markdown

This pull request requires additional validation before any workflows can run on NVIDIA's runners.

Pull request vetters can view their responsibilities here.

Contributors can view more details about this message here.

yifjiang commented Nov 4, 2026

Copy link
Copy Markdown
Contributor Author

/ok to test 5fe6b39

Signed-off-by: Yifan Jiang <19356972+yifjiang@users.noreply.github.com>
@yifjiang
yifjiang force-pushed the codex/kv-reuse-d21-complete-rank-groups branch from 5fe6b39 to a5d4b23 Compare November 5, 2026 00:24
@yifjiang

yifjiang commented Nov 5, 2026

Copy link
Copy Markdown
Contributor Author

/ok to test a5d4b23

@yifjiang yifjiang closed this Nov 5, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

backend::vllm Relates to the vllm backend feat size/L

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant