Skip to content

feat(router): expose calibrated independent CPU and GPU reuse controls [D30] - #18048

Closed
yifjiang wants to merge 1 commit into
codex/kv-reuse-d29-prefix-handoff-ownershipfrom
codex/kv-reuse-d30-reuse-configuration
Closed

yifjiang wants to merge 1 commit into
codex/kv-reuse-d29-prefix-handoff-ownershipfrom
codex/kv-reuse-d30-reuse-configuration

Conversation

@yifjiang

@yifjiang yifjiang commented Nov 4, 2026 •

Copy link
Copy Markdown
Contributor

Summary

CPU/GPU remain independently default off. CLI/env/YAML and kwargs flow, default and rejection paths, public reference docs; release remains held until D31.

Review slice D30 of #16748; part of #16747 and #16746. This draft targets codex/kv-reuse-d29-prefix-handoff-ownership for a complete incremental review diff of 370 additions plus deletions, including tests, documentation and extraction glue.

Extraction details:

  • Extend the shared Rust/Python YAML fixture with the eight fields only when both APIs accept them.
  • Replace D08’s temporary binding-default seam with all eight explicit fields.
  • Eight actual nondefault kwargs update the existing planner field-coverage test immediately; D31 removes this staging glue when its shared constants land.
  • Captured ArgEnv forwarding is present from the first new registration; its all-eight regression follows D31.
  • Three-way source merges preserve public-main frontend, binding and reference additions.

Reuse remains experimental and default off. Retained inventory is advisory, complete compatible rank parts must precede readiness, and native operations retain ownership until quiescence. Supported GPU activation also requires the companion KVCR/native slices and the declared deployment profile.

Validation

All configured pre-commit hooks passed for this exact slice on allocated SLURM. Stack-level CPU regression coverage is summarized on D31; each draft still requires its own applicable CI in the Checks tab. Historical combined-head and hardware results retain their original source scope.

@github-actions github-actions Bot added feat documentation Improvements or additions to documentation planner frontend `python -m dynamo.frontend` and `dynamo-run in=http|text|grpc` labels Nov 4, 2026
@github-actions

github-actions Bot commented Nov 4, 2026 •

Copy link
Copy Markdown
Contributor

@yifjiang
yifjiang force-pushed the codex/kv-reuse-d30-reuse-configuration branch from 7ec816e to cb46aaf Compare November 4, 2026 08:16
@yifjiang
yifjiang force-pushed the codex/kv-reuse-d29-prefix-handoff-ownership branch from eba9362 to c63273d Compare November 4, 2026 08:16
@yifjiang
yifjiang force-pushed the codex/kv-reuse-d30-reuse-configuration branch from cb46aaf to df1f60d Compare November 4, 2026 08:28
@yifjiang
yifjiang force-pushed the codex/kv-reuse-d29-prefix-handoff-ownership branch 2 times, most recently from 9d80e26 to c9ab21c Compare November 4, 2026 08:34
@yifjiang
yifjiang force-pushed the codex/kv-reuse-d30-reuse-configuration branch 2 times, most recently from 8633b98 to b5a6226 Compare November 4, 2026 08:54
@devin-ai-integration

devin-ai-integration Bot commented Nov 4, 2026 •

Copy link
Copy Markdown
Contributor

✅ Dynamo PR CI passed — run 41941718477 (attempt 1) on 0af9656d5b

Gate checks: ✅ backend-status-check · ✅ deploy-status-check · ✅ dynamo-status-check

Posted automatically by Devin for run 41941718477. Updated on every full-CI run of this PR.

@yifjiang
yifjiang force-pushed the codex/kv-reuse-d30-reuse-configuration branch from b5a6226 to a82d9b9 Compare November 4, 2026 20:39
@copy-pr-bot

copy-pr-bot Bot commented Nov 4, 2026

Copy link
Copy Markdown

This pull request requires additional validation before any workflows can run on NVIDIA's runners.

Pull request vetters can view their responsibilities here.

Contributors can view more details about this message here.

yifjiang commented Nov 4, 2026

Copy link
Copy Markdown
Contributor Author

/ok to test a82d9b9

Signed-off-by: Yifan Jiang <19356972+yifjiang@users.noreply.github.com>
@yifjiang
yifjiang force-pushed the codex/kv-reuse-d29-prefix-handoff-ownership branch from 368bd89 to 47ca562 Compare November 5, 2026 00:24
@yifjiang
yifjiang force-pushed the codex/kv-reuse-d30-reuse-configuration branch from a82d9b9 to 0af9656 Compare November 5, 2026 00:24
@yifjiang

yifjiang commented Nov 5, 2026

Copy link
Copy Markdown
Contributor Author

/ok to test 0af9656

@yifjiang yifjiang closed this Nov 5, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

documentation Improvements or additions to documentation feat frontend `python -m dynamo.frontend` and `dynamo-run in=http|text|grpc` planner size/L

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant