Skip to content

feat(kvbm): retain FABRIC mappings until native work quiesces [D19] - #18037

Closed
yifjiang wants to merge 1 commit into
codex/kv-reuse-d18-typed-cuda-fabricfrom
codex/kv-reuse-d19-fabric-allocation-lifetimes
Closed

yifjiang wants to merge 1 commit into
codex/kv-reuse-d18-typed-cuda-fabricfrom
codex/kv-reuse-d19-fabric-allocation-lifetimes

Conversation

@yifjiang

@yifjiang yifjiang commented Nov 4, 2026 •

Copy link
Copy Markdown
Contributor

Summary

Typed VMM device/fabric allocation, partial rollback and import admission; failed synchronization retains/quarantines owners, finalization avoids CUDA.

Review slice D19 of #16748; part of #16747 and #16746. This draft targets codex/kv-reuse-d18-typed-cuda-fabric for a complete incremental review diff of 351 additions plus deletions, including tests, documentation and extraction glue.

Reuse remains experimental and default off. Retained inventory is advisory, complete compatible rank parts must precede readiness, and native operations retain ownership until quiescence. Supported GPU activation also requires the companion KVCR/native slices and the declared deployment profile.

Validation

All configured pre-commit hooks passed for this exact slice on allocated SLURM. Stack-level CPU regression coverage is summarized on D31; each draft still requires its own applicable CI in the Checks tab. Historical combined-head and hardware results retain their original source scope.

@github-actions github-actions Bot added feat backend::vllm Relates to the vllm backend labels Nov 4, 2026
@devin-ai-integration

devin-ai-integration Bot commented Nov 4, 2026 •

Copy link
Copy Markdown
Contributor

✅ Dynamo PR CI passed — run 41941677092 (attempt 2) on d7bc033616

Gate checks: ✅ backend-status-check · ✅ deploy-status-check · ✅ dynamo-status-check

Posted automatically by Devin for run 41941677092. Updated on every full-CI run of this PR.

@yifjiang
yifjiang force-pushed the codex/kv-reuse-d18-typed-cuda-fabric branch from 731684c to 9eda452 Compare November 4, 2026 08:16
@yifjiang
yifjiang force-pushed the codex/kv-reuse-d19-fabric-allocation-lifetimes branch 2 times, most recently from 6235bf7 to ac5a8ab Compare November 4, 2026 08:34
@yifjiang
yifjiang force-pushed the codex/kv-reuse-d18-typed-cuda-fabric branch from 9eda452 to 7eff72f Compare November 4, 2026 08:34
@yifjiang
yifjiang force-pushed the codex/kv-reuse-d19-fabric-allocation-lifetimes branch from ac5a8ab to e6404c2 Compare November 4, 2026 08:54
@yifjiang
yifjiang force-pushed the codex/kv-reuse-d18-typed-cuda-fabric branch from 7eff72f to e4beb7c Compare November 4, 2026 08:54
@yifjiang
yifjiang force-pushed the codex/kv-reuse-d19-fabric-allocation-lifetimes branch from e6404c2 to 77d29a2 Compare November 4, 2026 20:39
@yifjiang
yifjiang force-pushed the codex/kv-reuse-d18-typed-cuda-fabric branch from e4beb7c to 62c981a Compare November 4, 2026 20:39
@copy-pr-bot

copy-pr-bot Bot commented Nov 4, 2026

Copy link
Copy Markdown

This pull request requires additional validation before any workflows can run on NVIDIA's runners.

Pull request vetters can view their responsibilities here.

Contributors can view more details about this message here.

1 similar comment
@copy-pr-bot

copy-pr-bot Bot commented Nov 4, 2026

Copy link
Copy Markdown

This pull request requires additional validation before any workflows can run on NVIDIA's runners.

Pull request vetters can view their responsibilities here.

Contributors can view more details about this message here.

yifjiang commented Nov 4, 2026

Copy link
Copy Markdown
Contributor Author

/ok to test 77d29a2

Signed-off-by: Yifan Jiang <19356972+yifjiang@users.noreply.github.com>
@yifjiang
yifjiang force-pushed the codex/kv-reuse-d19-fabric-allocation-lifetimes branch from 77d29a2 to d7bc033 Compare November 5, 2026 00:24
@yifjiang
yifjiang force-pushed the codex/kv-reuse-d18-typed-cuda-fabric branch from 62c981a to ada5e7f Compare November 5, 2026 00:24
@yifjiang

yifjiang commented Nov 5, 2026

Copy link
Copy Markdown
Contributor Author

/ok to test d7bc033

@yifjiang yifjiang closed this Nov 5, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

backend::vllm Relates to the vllm backend feat size/L

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant