Skip to content

feat(kvbm): register fabric banks and verify retained GPU hint routing [D20] - #18038

Closed
yifjiang wants to merge 1 commit into
codex/kv-reuse-d19-fabric-allocation-lifetimesfrom
codex/kv-reuse-d20-fabric-bank-registration
Closed

yifjiang wants to merge 1 commit into
codex/kv-reuse-d19-fabric-allocation-lifetimesfrom
codex/kv-reuse-d20-fabric-bank-registration

Conversation

@yifjiang

@yifjiang yifjiang commented Nov 4, 2026 •

Copy link
Copy Markdown
Contributor

Summary

Admit observed fabric descriptors without mutating model config; GPU final dispatch, target baseline and topology proofs share the same compatibility contract.

Review slice D20 of #16748; part of #16747 and #16746. This draft targets codex/kv-reuse-d19-fabric-allocation-lifetimes for a complete incremental review diff of 468 additions plus deletions, including tests, documentation and extraction glue.

Extraction details:

  • Defer profile-constructor MNNVL tests to D26; these banks and imports are independently functional now.
  • Four full routing integration regressions join actual D14 fixtures.

Reuse remains experimental and default off. Retained inventory is advisory, complete compatible rank parts must precede readiness, and native operations retain ownership until quiescence. Supported GPU activation also requires the companion KVCR/native slices and the declared deployment profile.

Validation

All configured pre-commit hooks passed for this exact slice on allocated SLURM. Stack-level CPU regression coverage is summarized on D31; each draft still requires its own applicable CI in the Checks tab. Historical combined-head and hardware results retain their original source scope.

@github-actions github-actions Bot added feat backend::vllm Relates to the vllm backend router Relates to routing, KV-aware routing, etc. labels Nov 4, 2026
@devin-ai-integration

devin-ai-integration Bot commented Nov 4, 2026 •

Copy link
Copy Markdown
Contributor

✅ Dynamo PR CI passed — run 41941680747 (attempt 2) on 0cf63965fc

Gate checks: ✅ backend-status-check · ✅ deploy-status-check · ✅ dynamo-status-check

Posted automatically by Devin for run 41941680747. Updated on every full-CI run of this PR.

@yifjiang
yifjiang force-pushed the codex/kv-reuse-d20-fabric-bank-registration branch from a5965f4 to dc723e4 Compare November 4, 2026 08:16
@yifjiang
yifjiang force-pushed the codex/kv-reuse-d19-fabric-allocation-lifetimes branch from 9f3bb4d to 6235bf7 Compare November 4, 2026 08:16
@yifjiang
yifjiang force-pushed the codex/kv-reuse-d20-fabric-bank-registration branch from dc723e4 to ea735f5 Compare November 4, 2026 08:34
@yifjiang
yifjiang force-pushed the codex/kv-reuse-d19-fabric-allocation-lifetimes branch from ac5a8ab to e6404c2 Compare November 4, 2026 08:54
@yifjiang
yifjiang force-pushed the codex/kv-reuse-d20-fabric-bank-registration branch 2 times, most recently from a817ccd to bbefbff Compare November 4, 2026 20:39
@yifjiang
yifjiang force-pushed the codex/kv-reuse-d19-fabric-allocation-lifetimes branch from e6404c2 to 77d29a2 Compare November 4, 2026 20:39
@copy-pr-bot

copy-pr-bot Bot commented Nov 4, 2026

Copy link
Copy Markdown

This pull request requires additional validation before any workflows can run on NVIDIA's runners.

Pull request vetters can view their responsibilities here.

Contributors can view more details about this message here.

yifjiang commented Nov 4, 2026

Copy link
Copy Markdown
Contributor Author

/ok to test bbefbff

Signed-off-by: Yifan Jiang <19356972+yifjiang@users.noreply.github.com>
@yifjiang
yifjiang force-pushed the codex/kv-reuse-d19-fabric-allocation-lifetimes branch from 77d29a2 to d7bc033 Compare November 5, 2026 00:24
@yifjiang
yifjiang force-pushed the codex/kv-reuse-d20-fabric-bank-registration branch from bbefbff to 0cf6396 Compare November 5, 2026 00:24
@yifjiang

yifjiang commented Nov 5, 2026

Copy link
Copy Markdown
Contributor Author

/ok to test 0cf6396

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

backend::vllm Relates to the vllm backend feat router Relates to routing, KV-aware routing, etc. size/L

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant