Skip to content

chore(router): remove power-of-two and plugin-API paths marked for 1.7.0 removal - #17899

Merged
karen-sy merged 31 commits into
mainfrom
karenc/dyn-5297-router-cleanup
Nov 4, 2026
Merged

karen-sy merged 31 commits into
mainfrom
karenc/dyn-5297-router-cleanup

Conversation

@karen-sy

@karen-sy karen-sy commented Nov 3, 2026 •

Copy link
Copy Markdown
Contributor

Overview

This removes the power-of-two router mode, a built-in policy we don't use (DYN-5265), and the plugin-API compatibility paths marked for removal in v1.7 (DYN-5297). Router modes and custom plugins each keep one supported surface: --router-mode takes round-robin, random, least-loaded, kv, direct or device-aware-weighted, and plugins import from dynamo_kv_router::plugins.

Key Changes

Core logic: +122 / −208 lines, net −86 (excluding tests, docs and comments). +41 / −35 of it is the custom-policy examples moving to the plugins:: paths. Most need review:

  • push_router.rs: RouterMode::PowerOfTwoChoices stays only as a wire value, resolve_selectors rejects it with an error naming the removal, and power_of_two_choices() is removed.
  • routing_host/builder.rs: hosted_picker rejects the same value for the routing host.
  • kv-router/src/lib.rs and plugins/registry.rs: the compatibility re-exports, WorkerSelectionPolicyRegistry and RouterPluginRegistry::register are removed.

Breaking:

  • CLI: --router-mode power-of-two, DYN_ROUTER_MODE=power-of-two and a policy file that names the power-of-two type fail at startup.
  • Rust and Python: PushRouter::power_of_two_choices(), the Python RouterMode.PowerOfTwoChoices, and the plugin-API paths outside plugins:: are removed. deprecations.mdx lists each replacement.
  • N-2: a v1.7 frontend still decodes cards from v1.5 and v1.6 workers that advertise power-of-two, then fails to build that worker set's router with the removal error, the targeted failure lib/llm/AGENTS.md asks for. The wire value goes in v1.9, when v1.6 leaves the window.

Validation

Case Before Now
--router-mode power-of-two Routes to the less loaded of two random workers Startup fails: argparse rejects the choice
DYN_ROUTER_MODE=power-of-two Same Startup fails: unknown router mode 'power-of-two'
Policy file naming type: power-of-two Runs the plugin on the KV path Startup fails: the type isn't registered
v1.5 or v1.6 worker card advertising power_of_two_choices Routed with power-of-two Card decodes; building its router fails with the power-of-two router mode was removed in Dynamo v1.7; use another router mode
Rust crate importing a removed plugin path Compiles through the re-export Compile error; deprecations.mdx names the replacement

The first three rows weren't run locally.

Issues and Ongoing Work

Pull Request Checklist
  • I used Dynamo's /pr-checklist skill.

Summary by CodeRabbit

  • Deprecations
    • power-of-two routing is deprecated and now emits a warning when used. Switch to least-loaded; removal is planned for v1.8.
  • Breaking Changes
    • Legacy router-plugin imports and registry APIs have been removed. Update integrations to use the plugin-specific imports, RouterPluginRegistry, and register_worker_selection.
    • The frontend worker-selection policy factory setter has been removed.
  • Documentation
    • Updated routing guides and API references to reflect these deprecations and migration paths.

karen-sy and others added 14 commits October 30, 2026 20:35
… on the hosted path

Plugins can now be shared across request threads without a lock, and a
picker-only policy can run outside the KV scheduler through a new hosted
entry point. This is the foundation for running the non-KV router modes as
ordinary plugins.

- WorkerFilter::keep, WorkerScorer::score and WorkerPicker::pick take
  &self, and the traits require Send + Sync. The default policy keeps its
  per-call state in a local and its sampling scratch in a thread-local
  buffer, so selection still allocates nothing.
- WorkerSelectionPolicy::into_hosted_picker returns a HostedWorkerPicker
  for a picker-only policy that declares at most ACTIVE_REQUESTS and has no
  runtime config; HostedWorkerPicker::select picks over a lazy view of the
  host's worker IDs with no candidate rows and no lock.
- WorkerInputs::ACTIVE_REQUESTS replaces OCCUPANCY (deprecated alias until
  v1.9), with WorkerInputView::active_requests(row), len() and is_empty().
- HostedSelectionRequest carries a hosted selection's request metadata.

BREAKING CHANGE: worker-selection plugin methods take &self instead of
&mut self, and the plugin traits require Send + Sync. A plugin that
mutates state between calls must use atomics or a lock.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Signed-off-by: Karen Chung <karenc@nvidia.com>
…er-policies

The crate holds every router policy Dynamo ships, including the routing
modes from the next commit; "custom" no longer described it. Mechanical:
the package name, its dependents' manifests and use paths, and both
lockfiles. The directory stays lib/router-plugins/builtin, and the
custom-catalog crate keeps its documented name.

BREAKING CHANGE: Rust dependents import dynamo_router_policies instead of
dynamo_custom_policy_builtin.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Signed-off-by: Karen Chung <karenc@nvidia.com>
--router-mode random, round-robin, least-loaded and power-of-two now
resolve by type name in the router plugin registry and run as ordinary
worker-selection plugins on the hosted path. Every selection algorithm
lives once, in the new dynamo-routing-algorithms crate.

- dynamo-routing-algorithms (lib/router-plugins/algorithms): random,
  round-robin, least-loaded, power-of-two and device-aware selection,
  index-based, depending only on fastrand.
- dynamo-router-policies: four &self pickers in router_modes, thin
  adapters over the algorithms, registered in default_registry().
- dynamo-runtime: RoutePicker dispatches to the shared algorithms;
  BuiltinRoutePicker is removed. PushRouter's API is unchanged.
- dynamo-kv-router: WorkerSelectionContext::is_preview,
  HostedSelectionRequest::with_preview and
  RouterPluginRegistry::resolve_type; the old WorkerSelectionInput::Hosted
  variant is removed.
- dynamo-llm: RoutingPolicy::Hosted(HostedWorkerPicker) replaces
  BuiltinWorkerSelector for the main and LoRA selectors; previews do not
  advance round-robin.

Device-aware weighted routing keeps its input plumbing in PushRouter for
now; only its algorithm moves.

BREAKING CHANGE: dynamo_runtime::pipeline::BuiltinRoutePicker and
dynamo_kv_router's WorkerSelectionInput::Hosted, into_hosted, hosted() and
HostedSelectionInputs are removed.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Signed-off-by: Karen Chung <karenc@nvidia.com>
Split router_modes.rs into router_modes/random.rs, round_robin.rs,
least_loaded.rs and power_of_two.rs. Each file holds its mode's type
name and picker. router_modes.rs keeps the shared helpers and the
registration, and re-exports the four type names, so callers are
unchanged.

Signed-off-by: Karen Chung <karenc@nvidia.com>
Signed-off-by: Karen Chung <karenc@nvidia.com>
Signed-off-by: Karen Chung <karenc@nvidia.com>
Signed-off-by: Karen Chung <karenc@nvidia.com>
Build the hosted selection request only when a picker runs, drop the narrating round-robin comment, return into_configured's tuple without a Result, and rename routing_host/builtin.rs to hosted.rs.

Signed-off-by: Karen Chung <karenc@nvidia.com>
Store the hosted picker as the policy's Box instead of converting it to an Arc nothing clones, and drop HostedSelectionRequest's three builders and its block_size argument, which no host calls. Hosted pickers see the same values as before: the prompt length, and the KV router's defaults for the rest.

Signed-off-by: Karen Chung <karenc@nvidia.com>
Signed-off-by: Karen Chung <karenc@nvidia.com>
…ance selectors

Delete dynamo-routing-algorithms: the round-robin, random, least-loaded and
power-of-two algorithms now live only in their router-mode plugins.

PushRouter picks through an InstanceSelector passed in
PushRouterOptions::selectors and resolved when the router is built.
HostedWorkerPicker implements it, and dynamo-llm passes the plugins at every
PushRouter it builds. round_robin(), random(), power_of_two_choices() and
least_loaded() become aliases over one select path. Device-aware weighted
stays in the runtime.

Also regenerate lib/bindings/kvbm/Cargo.lock for the earlier crate rename.

Signed-off-by: Karen Chung <karenc@nvidia.com>
install_router_plugin_registry and the standalone EPP selector apply
dynamo_router_policies::with_defaults to the catalog they are given, which adds
Dynamo's default and each routing mode the catalog lacks, so --router-mode and a
policy file naming a mode type resolve however the catalog was built.

The routing-mode providers reject a parameters block, like the other builtin
providers, and the into_hosted_picker rustdoc says the hosts call it only for the
four router-mode types for now.

Signed-off-by: Karen Chung <karenc@nvidia.com>
…worker ID

WorkerSelectionContext now holds the request values it exposes instead of borrowing the whole SchedulingRequest, so HostedSelectionRequest carries only the prompt length and SchedulingRequest::hosted() is gone. Hosted select returns the chosen WorkerId rather than a WorkerSelectionResult whose cache and load fields were always zero.

Signed-off-by: Karen Chung <karenc@nvidia.com>
…I paths

Deprecate the power-of-two router mode for removal in v1.8 (DYN-5265).
--router-mode power-of-two and a policy file naming the power-of-two type
still work and log a deprecation warning, and
PushRouter::power_of_two_choices() is marked #[deprecated]. The
RouterMode::PowerOfTwoChoices model-card value stays decodable until v1.9
for N-2 workers.

Remove the plugin-API compatibility paths marked for v1.7 (DYN-5297): the
kv-router re-exports of the worker-selection types outside plugins::,
WorkerSelectionPolicyRegistry, RouterPluginRegistry::register, and the
dynamo-llm install_worker_selection_policy_registry,
worker_selection_policy_registry and
HttpFrontend::worker_selection_policy_factory aliases. In-tree callers, the
custom-policy examples and the docs now use the plugins:: paths,
RouterPluginRegistry and register_worker_selection.

Signed-off-by: Karen Chung <karenc@nvidia.com>
@karen-sy
karen-sy requested review from a team as code owners November 3, 2026 01:37
@github-actions github-actions Bot added refactor documentation Improvements or additions to documentation frontend `python -m dynamo.frontend` and `dynamo-run in=http|text|grpc` router Relates to routing, KV-aware routing, etc. labels Nov 3, 2026
@karen-sy
karen-sy added this pull request to stack #17714 November 3, 2026 01:41
@github-actions

github-actions Bot commented Nov 3, 2026 •

Copy link
Copy Markdown
Contributor

@coderabbitai

coderabbitai Bot commented Nov 3, 2026 •

Copy link
Copy Markdown
Contributor

Review in Change Stack →

Walkthrough

The changes deprecate power-of-two routing while retaining it, and remove legacy worker-selection and request-classifier API paths. Router integrations, tests, benchmarks, custom-policy examples, and documentation are updated to use the plugin APIs.

Changes

Power-of-two deprecation

Layer / File(s) Summary
Deprecation warnings and mode annotations
components/src/dynamo/common/configuration/groups/router_args.py, components/src/dynamo/common/tests/configuration/test_router_advertisement.py, lib/router-plugins/builtin/src/router_modes*, lib/bindings/python/*, lib/runtime/src/pipeline/network/egress/push_router.rs
Configuration building logs a warning when the selected mode is power-of-two. The built-in policy provider also warns on resolution and delegates to the existing provider. Tests check when the configuration warning appears. Comments and annotations mark the mode for removal.
Deprecation documentation
docs/fern/pages/cli/operations/lora-adapters.md, docs/fern/pages/developer-guide/knowledge-base/modular-components/*, docs/fern/pages/reference/components/*, docs/fern/pages/reference/general/releases/deprecations.mdx
The documentation marks power-of-two as deprecated and recommends replacement modes. The release ledger records removal timelines, including the later model-card value timeline.

Router plugin API migration

Layer / File(s) Summary
Plugin API contracts and internal router references
lib/kv-router/src/*, lib/kv-router/tests/plugin_api_compat.rs
The router crate removes compatibility exports, the WorkerSelectionPolicyRegistry alias, and the compatibility register method. Internal configuration and scheduling references use plugin-module types. The API compatibility test uses the public plugin modules and RouterPluginRegistry.
Gateway, LLM, and built-in plugin integrations
deploy/inference-gateway/ext-proc/src/*, lib/llm/src/*, lib/router-plugins/builtin/*
Gateway APIs and tests use RouterPluginRegistry. LLM code imports worker-selection and request-classifier types from their plugin modules and removes the worker-selection frontend setter. Built-in benchmarks and tests use the plugin module paths.
Custom-policy examples and migration guidance
examples/router/custom-policy-example/*, docs/fern/pages/developer-guide/knowledge-base/modular-components/router/custom-worker-selection.mdx, docs/fern/pages/reference/general/releases/deprecations.mdx
Custom-policy examples use RouterPluginRegistry and register_worker_selection, with worker-selection types imported from the plugin module. The migration notes describe removed names and the replacement APIs.

Estimated code review effort: 4 (Complex) | ~45 minutes

Merge Risk: Moderate · up to 87367

This change deprecates power-of-two routing and removes the old plugin API paths. The migration guidance for KV policy-file users and for frontend classifier chains is wrong in ways that could silently change routing or admission behaviour for people who follow it. Correct those docs before merging; the remaining items are small fixes.

Pre-merge checks: Passed 3 · Failed 1 · Inconclusive 1

Failed Failed checks: 1 warning · 1 inconclusive

Check name Status Explanation Resolution
Title check Warning The title accurately mentions removal of plugin-API compatibility paths, but it incorrectly states that power-of-two is removed. The changes deprecate power-of-two and retain support until a later rem… Update the title to state that power-of-two is deprecated and that legacy plugin-API compatibility paths are removed, such as "chore(router): deprecate power-of-two and remove legacy plugin-API paths".
Docstring Coverage Inconclusive Docstring coverage is 35.00% which is insufficient. The required threshold is 80.00%. Docstring coverage is scoped to functions touched by this diff with cyclomatic complexity of at least 2. Documenta… Write docstrings for the functions missing them to satisfy the coverage threshold.
Passed Passed checks: 3 passed
Check name Status Explanation
Linked Issues check Passed Check skipped because no linked issues were found for this pull request.
Out of Scope Changes check Passed Check skipped because no linked issues were found for this pull request.
Description check Passed The description includes all required template sections: Overview, Key Changes, Validation, Issues and Ongoing Work, and the checklist. It provides detailed scope, validation results, linked issues, a…
Full details: Description check

Explanation

The description includes all required template sections: Overview, Key Changes, Validation, Issues and Ongoing Work, and the checklist. It provides detailed scope, validation results, linked issues, and follow-up work.

Full details: Title check

Explanation

The title accurately mentions removal of plugin-API compatibility paths, but it incorrectly states that power-of-two is removed. The changes deprecate power-of-two and retain support until a later removal.

Resolution

Update the title to state that power-of-two is deprecated and that legacy plugin-API compatibility paths are removed, such as "chore(router): deprecate power-of-two and remove legacy plugin-API paths".

Full details: Docstring Coverage

Explanation

Docstring coverage is 35.00% which is insufficient. The required threshold is 80.00%. Docstring coverage is scoped to functions touched by this diff with cyclomatic complexity of at least 2. Documentation-only edits and deletions within surviving functions are included; unchanged diff context and fully deleted functions are excluded. Analyzed 20 functions across 48 files. (22 skipped: 9 unsupported, 2 too large, 11 over the file limit.)

Resolution

Write docstrings for the functions missing them to satisfy the coverage threshold.

  • Autofix · Keep fixing CodeRabbit findings and required CI, and resolving merge conflicts

Warning

Some tools did not complete. Review the errors below.

ast-grep (0.51.1)

ast-grep could not parse rule config: /ast-grep-rules/ast-grep-essentials/rules/bash/security/hardcoded-credential-in-url-bash.yml

Tip

🎯 Customize your risk assessments

Guide how CodeRabbit assesses merge risk and security architecture risk. Highlight sensitive changes and explain your security boundaries using Merge Risk Instructions and Security Risk Instructions in your review settings. Security architecture risk assessments require the Advanced plan or above.

✅ Automatic approvals, with your rules

Let CodeRabbit approve pull requests once required threads are resolved, pre-merge checks pass, and your risk limits are met. Enable Automatic approvals in review settings, with overrides for teams or file paths.

CodeRabbit Verify

  • Run CodeRabbit Verify to test the changes in this pull request.
Recent review info
Run configuration
Commits

Reviewing files that changed from the base of the PR and between a7afeb0 and 873674b.

Files selected for processing: 72
  • components/src/dynamo/common/configuration/groups/router_args.py
  • components/src/dynamo/common/tests/configuration/test_router_advertisement.py
  • deploy/inference-gateway/ext-proc/src/epp_router.rs
  • deploy/inference-gateway/ext-proc/src/runner.rs
  • deploy/inference-gateway/ext-proc/src/selector.rs
  • deploy/inference-gateway/ext-proc/src/topology_adapter.rs
  • docs/fern/pages/cli/operations/lora-adapters.md
  • docs/fern/pages/developer-guide/knowledge-base/modular-components/frontend/overview.md
  • docs/fern/pages/developer-guide/knowledge-base/modular-components/router/custom-worker-selection.mdx
  • docs/fern/pages/developer-guide/knowledge-base/modular-components/router/router-guide.md
  • docs/fern/pages/developer-guide/knowledge-base/modular-components/router/routing-concepts.md
  • docs/fern/pages/reference/components/frontend-configuration.mdx
  • docs/fern/pages/reference/components/mocker-cli-reference.mdx
  • docs/fern/pages/reference/general/releases/deprecations.mdx
  • examples/router/custom-policy-example/README.md
  • examples/router/custom-policy-example/catalog/src/lib.rs
  • examples/router/custom-policy-example/disagg-filter-score-pick/src/filter.rs
  • examples/router/custom-policy-example/disagg-filter-score-pick/src/lib.rs
  • examples/router/custom-policy-example/disagg-filter-score-pick/src/picker.rs
  • examples/router/custom-policy-example/disagg-filter-score-pick/src/scorer.rs
  • examples/router/custom-policy-example/epp/src/main.rs
  • examples/router/custom-policy-example/simple-stacked-score-pick/src/lib.rs
  • examples/router/custom-policy-example/simple-stacked-score-pick/src/picker.rs
  • examples/router/custom-policy-example/simple-stacked-score-pick/src/scorer/active_requests.rs
  • examples/router/custom-policy-example/simple-stacked-score-pick/src/scorer/uncached_blocks.rs
  • examples/router/custom-policy-example/soft-pin-repin/src/lib.rs
  • lib/bindings/python/rust/lib.rs
  • lib/bindings/python/src/dynamo/_core.pyi
  • lib/kv-router/benches/selection_core.rs
  • lib/kv-router/benches/worker_selection.rs
  • lib/kv-router/src/lib.rs
  • lib/kv-router/src/plugins.rs
  • lib/kv-router/src/plugins/registry.rs
  • lib/kv-router/src/scheduling/config.rs
  • lib/kv-router/src/scheduling/local.rs
  • lib/kv-router/src/scheduling/mod.rs
  • lib/kv-router/src/scheduling/policy_config.rs
  • lib/kv-router/src/scheduling/queue.rs
  • lib/kv-router/src/scheduling/request_classifier.rs
  • lib/kv-router/src/scheduling/selector/mod.rs
  • lib/kv-router/src/scheduling/types.rs
  • lib/kv-router/src/services/selection/core/mod.rs
  • lib/kv-router/src/services/selection/core/tests.rs
  • lib/kv-router/src/services/selection/membership.rs
  • lib/kv-router/src/services/selection/mod.rs
  • lib/kv-router/src/services/selection/service.rs
  • lib/kv-router/src/services/selection/tests.rs
  • lib/kv-router/tests/plugin_api_compat.rs
  • lib/llm/src/discovery/model_manager.rs
  • lib/llm/src/discovery/watcher.rs
  • lib/llm/src/entrypoint/input/http.rs
  • lib/llm/src/kv_router.rs
  • lib/llm/src/kv_router/embedded.rs
  • lib/llm/src/kv_router/indexer/ingress.rs
  • lib/llm/src/kv_router/routing_host.rs
  • lib/llm/src/kv_router/routing_host/builder.rs
  • lib/llm/src/kv_router/routing_host/hosted.rs
  • lib/llm/src/kv_router/routing_host/request_guard.rs
  • lib/llm/src/kv_router/routing_host/tests.rs
  • lib/llm/src/migration.rs
  • lib/llm/src/protocols/common/preprocessor.rs
  • lib/router-plugins/builtin/benches/default_lifecycle.rs
  • lib/router-plugins/builtin/benches/default_selection.rs
  • lib/router-plugins/builtin/src/router_modes.rs
  • lib/router-plugins/builtin/src/router_modes/power_of_two.rs
  • lib/router-plugins/builtin/src/thunderagent/worker_selection/mod.rs
  • lib/router-plugins/builtin/tests/batch_scoring.rs
  • lib/router-plugins/builtin/tests/cache_inputs.rs
  • lib/router-plugins/builtin/tests/default_lifecycle.rs
  • lib/router-plugins/builtin/tests/default_policy.rs
  • lib/router-plugins/builtin/tests/router_modes.rs
  • lib/runtime/src/pipeline/network/egress/push_router.rs
Files with no reviewable changes: 2
  • lib/kv-router/src/lib.rs
  • lib/kv-router/src/scheduling/mod.rs

Included review availability: This review used your included allowance. Your plan provides up to 12 included reviews per hour; 11 remain after this review.

@coderabbitai coderabbitai Bot left a comment •

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

  • Fix comments: Fix CodeRabbit comments on this PR

Keep both v1.7.0 deprecations.mdx entries. Port main's new
dynamo-sticky-min-load picker to the &self WorkerPicker trait by holding
its session bindings behind a lock.

Signed-off-by: Karen Chung <karenc@nvidia.com>
Signed-off-by: Karen Chung <karenc@nvidia.com>
Bring in main's fix for the SGLang sidecar build (#17980).

Signed-off-by: Karen Chung <karenc@nvidia.com>
…cleanup

Bring in main through PR 2, now that #17712 has landed, along with PR 2's
occupancy fix and release notes.

Signed-off-by: Karen Chung <karenc@nvidia.com>
Base automatically changed from karenc/router-modes-2-plugin-modes to main November 4, 2026 00:08
@karen-sy
karen-sy requested review from a team as code owners November 4, 2026 00:08
Bring in main after #17713 landed. This branch already holds #17713's
changes from the stacked PR 2 commits, so the merge adds only main's
commits before the squash.

Signed-off-by: Karen Chung <karenc@nvidia.com>
@karen-sy
karen-sy enabled stacked auto-merge (squash) November 4, 2026 00:20
@karen-sy
karen-sy merged commit 2164107 into main Nov 4, 2026
127 checks passed
@karen-sy
karen-sy deleted the karenc/dyn-5297-router-cleanup branch November 4, 2026 02:15
tanmayv25 pushed a commit that referenced this pull request Nov 4, 2026
#17483 added live-retune test cases that pass --router-mode power-of-two
to the frontend and a worker. #17899 removed that mode, and the two
merged 29 minutes apart, so main's planner unit tests fail on both
cases. Use least-loaded for the frontend case and drop the worker case,
which the random, least-loaded and --router-mode=kv cases already cover.

Refs DYN-5265

Signed-off-by: Karen Chung <karenc@nvidia.com>
Signed-off-by: tanmayv25 <tanmay2592@gmail.com>
ishandhanani added a commit to ishandhanani/dynamo that referenced this pull request Nov 4, 2026
Absorbs the 95 upstream commits since 464ff29. Each upstream change lands in the crate that owns that code at the stack head; the stack's moves stay intact. Router-touching PRs and where they landed:

- ai-dynamo#17712 host-path routing modes for worker-selection plugins: &self + Send + Sync plugin traits and WorkerInputs::ACTIVE_REQUESTS (deprecated OCCUPANCY alias) in dynamo-worker-selection and dynamo-router-protocol; HostedWorkerPicker and HostedSelectionRequest in dynamo-worker-selection (hosted.rs), reporting SelectionFailure, which the kernel converts into KvSchedulerError; the InstanceSelector adapter in lib/llm (HostedInstanceSelector); the compat test's hosted coverage in kv-router's prelude test.
- ai-dynamo#17713 random/round-robin/least-loaded as builtin plugins: router_modes in dynamo-router-policies (renamed from dynamo-custom-policy-builtin) importing the prelude; RouterPluginRegistry::resolve_type in kv-router; the frontend's hosted path through dynamo_worker_selection::host.
- ai-dynamo#17899 1.7.0 removals: taken whole; the alias and the setter were gone at the head; power-of-two never arrives.
- ai-dynamo#17657 single-source fetch continuations: KvTransferSourceInterval and source_intervals in dynamo-kv-indexer, the bucketed summary in dynamo-kv-hints, the interval filter in the kernel's resolver; tests in the kernel.
- ai-dynamo#17856 KVCR hints in offline replay: mocker and lib/llm bodies; supports_kv_transfer_chain_retention on the flat config; its indexer-vs-config test in kv-router's core host tests.
- ai-dynamo#17794 vLLM partial-tail filter and ai-dynamo#17126 SGLang engine-owned multimodal pads: dynamo-kv-events zmq_wire (mm_exclusion.rs); the codec-plus-indexer tests in dynamo-kv-indexer; the engine_owned_mm_identity worker flag through the kernel's WorkerRequest, kv-router's indexer registry and run config, and the bindings.
- ai-dynamo#17653 SGLang 0.5.23: pad constant docs in dynamo-multimodal.
- ai-dynamo#15333, ai-dynamo#17874, ai-dynamo#17484, ai-dynamo#17688, ai-dynamo#17237, ai-dynamo#17894, ai-dynamo#17958: host-side changes merged in place (bindings, lib/llm, CI).

Lockfiles regenerated; no shim reintroduced.

Signed-off-by: Ishan Dhanani <ishandhanani@gmail.com>
karen-sy added a commit that referenced this pull request Nov 4, 2026
#18092 picks #17899 into release/1.7.0, which removes the power-of-two
router mode. Swap the two power-of-two cases for device-aware-weighted,
as #14775 did on main, so these tests pass on release/1.7.0 with or
without #18092.

Refs DYN-5265

Signed-off-by: Karen Chung <karenc@nvidia.com>
aylonsk added a commit to aylonsk/dynamo that referenced this pull request Nov 4, 2026
…dency-signal

Picks up the test_live_retune_frontend_config.py update from ai-dynamo#14775. The
previous merge took main inside the window between ai-dynamo#17899 (which removed
the power-of-two router mode) and that update, so the planner CPU and
runtime sequential suites failed on two power-of-two cases.

Signed-off-by: Akira Lonske <akiralonske@gmail.com>
jain-ria added a commit that referenced this pull request Nov 5, 2026
Drop the power-of-two router-mode spelling: main removed it (#17899).

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Signed-off-by: jain-ria <riajain@NVIDIA.com>
nv-nmailhot pushed a commit that referenced this pull request Nov 5, 2026
… paths marked for 1.7.0 removal (#17899) (#18092)

Signed-off-by: Karen Chung <karenc@nvidia.com>
Co-authored-by: ishandhanani <82981111+ishandhanani@users.noreply.github.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

chore documentation Improvements or additions to documentation frontend `python -m dynamo.frontend` and `dynamo-run in=http|text|grpc` router Relates to routing, KV-aware routing, etc. size/XL

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants