Skip to content

refactor(router): add dynamo-multimodal and move the block hash identities to dynamo-kv-hashing - #170

Closed
ishandhanani wants to merge 2 commits into
idhanani/dyn-191-indexer-owns-candidatesfrom
idhanani/dyn-190-multimodal-and-block-hash
Closed

ishandhanani wants to merge 2 commits into
idhanani/dyn-191-indexer-owns-candidatesfrom
idhanani/dyn-190-multimodal-and-block-hash

Conversation

@ishandhanani

Copy link
Copy Markdown
Owner

Router split v2 follow-up (DYNO-190). Stacked on #169.

Summary

Two commits, both move-only, no behavior change. Rule applied: the producer owns its output types; dynamo-router-protocol is counterparty wire and identity only. After this PR protocol's modules are attempt columns identity metadata session worker worker_type and protocol has no relation to hashing or to multimodal identity.

  • Commit 1 (c108ce9097), refactor(router): move the block hash identities to dynamo-kv-hashing: git mv lib/router/protocol/src/block_hash.rs lib/kv-hashing/src/block_hash.rs whole (LocalBlockHash, ExternalSequenceBlockHash, From<u64>, From<i64>, the four manual serde impls, the two tests). The hash contract produces these identities (compute_block_hash* return LocalBlockHash; ExternalSequenceBlockHash is what engines publish and kv-hashing's rules recompute), so kv-hashing owns them and re-exports both at the root. routing.rs imports crate::block_hash::LocalBlockHash and its doc link names crate::ExternalSequenceBlockHash. Move-diff from 94513b3f60 over the file and the kv-hashing root: summary from_normalized=67 to_normalized=67 common=67 new=0 dropped=0, result MOVE (the mod block_hash; line and the root pub use are import lines the tool normalizes away, so nothing is new).
  • Commit 2 (ecc0595e94), feat(router): add dynamo-multimodal, the multimodal identity contract engines and the router share: new leaf crate lib/multimodal (package dynamo-multimodal, tier 1, #![deny(missing_docs)], [dependencies] exactly serde and xxhash-rust, no Dynamo crate; private modules extra_key, info, pad with root re-exports by name; README, AGENTS, and the @AGENTS.md twin). Three moves, text verbatim: (1) lib/router/protocol/src/mm.rs -> lib/multimodal/src/info.rs whole (git mv: BlockMmObjectInfo, BlockExtraInfo, RequestMmObjectInfo, RequestExtraInfo, to_block_level); (2) from lib/kv-hashing/src/routing.rs -> lib/multimodal/src/pad.rs: MM_PAD_SHIFT_VALUE, MM_PAD_HASH_MASK (with the SGLang drift comment), pad_value_for_mm_hash, hash_mm_identifier, and their three tests; routing.rs keeps BlockHashOptions and every compute_*, consuming dynamo_multimodal::BlockExtraInfo; (3) from lib/kv-events/src/zmq_wire/extra_keys.rs -> lib/multimodal/src/extra_key.rs: mark_mm_hash_for_extra_key, parse_mm_hash_from_extra_key, and only_frontend_padded_mm_hashes_are_parsed; kv-events keeps DYNAMO_CACHE_SALT_PREFIX, extra_keys_to_cache_namespace, extra_keys_to_block_mm_infos (they take the ZMQ wire item) and imports the parser; zmq_wire/mod.rs drops the two moved names from its re-export list (no shim; a move is a move). Move-diff from c108ce9097 over the four sources and seven destinations: summary from_normalized=1132 to_normalized=1137 common=1132 new=5 dropped=0; the tool prints result DIFFERS by its strict definition, and the five new normalized lines are exactly the new crate's structure, not moved text: #![deny(missing_docs)] (1x) and the mod tests { / } wrappers of pad.rs and extra_key.rs (2x each; the #[cfg(test)] attribute lines are normalized away, the braces are not). Nothing dropped, so no moved line changed or was lost.
  • Stays where it is (recorded in the new crate's AGENTS.md): kv-events convert.rs placeholder-run normalization and the extra_keys_to_* codec; kv-hashing compute_block_hash* (consumer of BlockExtraInfo); lib/llm model-specific mm routing (preprocessor/mm_routing/*, embedding caches, encoder router); kv-hashing request.rs RequestMmObjectInfo, a different shape with the same name for the PLH request (follow-up, untouched). lib/sidecar/vllm/src/convert.rs keeps its own DYNAMO_CACHE_SALT_PREFIX copy (untouched).
  • Protocol keeps serde_json in [dependencies]: its metadata.rs and worker_type.rs tests still use it, so the documented exact set (serde, serde_json, thiserror) and the gate row are unchanged.

Edges before -> after

  • kv-hashing: protocol -> multimodal (protocol dropped; grep -rn dynamo_router_protocol lib/kv-hashing is empty incl. tests and benches). Protocol forbidden in its closure from now on.
  • kv-events: protocol, kv-hashing -> protocol, kv-hashing, multimodal. scheduler, kv-router, lib/llm, Python bindings: gain multimodal as a direct dependency. kv-indexer and kv-hints: reach multimodal through kv-hashing only (closure column gains it, direct set unchanged).
  • kv-hints: gains kv-hashing directly (commit 1; its wire.rs names ExternalSequenceBlockHash; the crate was already in its closure through the indexer).
  • protocol: no edge change; loses block_hash and mm. Every stage crate (slot-tracker, session-affinity, worker-selection, admission), zmq, and error forbid dynamo-multimodal in the gate.
  • Workspace: lib/multimodal member and dynamo-multimodal = { path = "lib/multimodal", version = "1.7.0" }; lib/bindings/python/Cargo.toml adds the path dependency; root, lib/bindings/python, and lib/bindings/kvbm lockfiles regenerated.

Deprecated shims

  • lib/kv-router/src/protocols.rs and lib/router/scheduler/src/protocols.rs DROP ExternalSequenceBlockHash and LocalBlockHash (owner decision 2026-11-02: no shim for the block hash names). The 57 direct-path importers and the kernel's twelve files that took the names through crate::protocols (kv_hints, local, overlap_refresh, queue, selection/core/{mod,operation,tests}, selection/{input,pending}, selector/policy_tests, tracking_hash, types) plus kv-router's core_host_tests now import dynamo_kv_hashing::{ExternalSequenceBlockHash, LocalBlockHash}. dynamo_kv_router::LocalBlockHash stays at the crate root (deprecated as before), now sourced from kv-hashing.
  • Both shims KEEP every mm name, re-pointed to dynamo_multimodal: BlockExtraInfo, BlockMmObjectInfo, RequestExtraInfo, RequestMmObjectInfo, MM_PAD_HASH_MASK, MM_PAD_SHIFT_VALUE, hash_mm_identifier, pad_value_for_mm_hash (the last four leave the dynamo_kv_hashing::routing::{...} list).
  • The plugins prelude (lib/kv-router/src/plugins/prelude.rs) is the tier-1 plugin API, not a shim: it keeps ExternalSequenceBlockHash, re-pointed; the kv-indexer prelude.rs likewise. The builtin plugin tests and bench compile unchanged through the prelude. The prelude names no mm item.

Gate (scripts/router_layering_check.sh)

  • New row dynamo-multimodal | - | <every router crate, dynamo-runtime, dynamo-tokens, tokio anyhow tracing async-trait derive_builder thiserror prometheus axum hyper reqwest zmq> | serde xxhash-rust | -; ROUTER_FAMILY gains dynamo-multimodal (first); ROUTER_CRATE_DIRS gains lib/multimodal; COMPOSITION_ROUTER_DEPS and COMPOSITION_DIRECT_DEPS gain dynamo-multimodal.
  • kv-hashing row: column 2 dynamo-multimodal; column 3 gains dynamo-router-protocol; column 4 derive_builder dynamo-multimodal dynamo-tokens serde serde_json thiserror xxhash-rust.
  • kv-events and scheduler rows: columns 2 and 4 gain dynamo-multimodal. kv-indexer and kv-hints rows: column 2 gains it, column 4 unchanged. kv-hints row column 4 gains dynamo-kv-hashing (commit 1).
  • protocol, zmq, error, slot-tracker, session-affinity, worker-selection, admission rows: column 3 gains dynamo-multimodal.
  • scripts/router_public_api_check.sh: sixth snapshot lib/multimodal/public-api.txt. Codeowners: lib/multimodal/ under the router area's path_globs and a router + multimodal co-ownership glob mirroring lib/kv-events/src/zmq_wire/extra_keys.rs; CODEOWNERS regenerated (+2 rules), strict check 100%.

Snapshots (scripts/router_public_api_check.sh --update, every changed line)

  • Commit 1: lib/router/protocol/public-api.txt 251 -> 236: -15, pub mod block_hash, both structs, From<u64> and From<i64> (impl + fn), the four serde impls and their fns. lib/kv-router/public-api.txt 1398 -> 1396: -2, pub use dynamo_kv_router::protocols::ExternalSequenceBlockHash and pub use dynamo_kv_router::protocols::LocalBlockHash (the dropped shim names); 8 lines changed, defining path only: KvRouterConfig::compute_seq_hashes_for_tracking and compute_seq_hashes_for_tracking_with_context at the four paths KvRouterConfig appears now name dynamo_kv_hashing::block_hash::LocalBlockHash. lib/kv-hints/public-api.txt 134, 2 lines changed (KvSourceLocationsPayload::block_hashes at wire:: and the root) and lib/kv-events/public-api.txt 257, 4 lines changed (KvCacheRemoveData::block_hashes, KvCacheStoreData::parent_hash, KvCacheStoredBlockData::block_hash, KvCacheStoredBlockData::tokens_hash): defining path dynamo_router_protocol::block_hash:: -> dynamo_kv_hashing::block_hash::, nothing added or removed. lib/error/public-api.txt 134 byte-identical.
  • Commit 2: new lib/multimodal/public-api.txt, 19 items (BlockExtraInfo, BlockMmObjectInfo, RequestExtraInfo + to_block_level, RequestMmObjectInfo and their fields, MM_PAD_HASH_MASK, MM_PAD_SHIFT_VALUE, hash_mm_identifier, mark_mm_hash_for_extra_key, pad_value_for_mm_hash, parse_mm_hash_from_extra_key). lib/router/protocol/public-api.txt 236 -> 223: -13, pub mod mm, the four structs, their fields, impl RequestExtraInfo, to_block_level. lib/kv-events/public-api.txt 257 -> 255: -2, zmq_wire::mark_mm_hash_for_extra_key and zmq_wire::parse_mm_hash_from_extra_key; 5 lines changed, defining path only (KvCacheStoredBlockData::mm_extra_info, RawKvEvent::BlockStored::block_mm_infos, StoredBlockOptions::mm_extra_info, create_stored_blocks, extra_keys_to_block_mm_infos: dynamo_router_protocol::mm::BlockExtraInfo -> dynamo_multimodal::info::BlockExtraInfo). lib/kv-router/public-api.txt 1396, lib/kv-hints/public-api.txt 134, lib/error/public-api.txt 134 byte-identical: the shims' mm names render as pub use lines without a defining path, and no kv-router or kv-hints signature names a multimodal type.
  • Final sizes: kv-router 1396, protocol 223, kv-events 255, kv-hints 134, error 134, multimodal 19.

Validation

Full chain on the final tree (/tmp/rr-split/chain-190.sh, log /tmp/rr-split/s190-validation.log on the build host; the same chain also ran on the commit-1 tree, log s190-c1-validation.log, all green). Every stage exit 0 except the pre-existing kvbm-consolidator manifest failure (unrelated, untouched, recorded).

  • dynamo-multimodal, dynamo-kv-hashing, dynamo-router-protocol, dynamo-kv-events, dynamo-kv-hints, dynamo-kv-indexer, dynamo-scheduler: cargo clippy -p <c> --all-targets -- -D warnings (default and --all-features); cargo test -p <c> --all-features (4; 19 + 17 + 3; 9; 64; 4; 597 + 2 ignored; 289 + 1 ignored); RUSTDOCFLAGS="-D warnings" cargo doc -p <c> --no-deps (default and --all-features). Test counts moved with the code: protocol 11 -> 9 (the two block hash tests now run in kv-hashing), kv-hashing 22 -> 19 and kv-events 65 -> 64 (the three pad tests and the marker test now run in multimodal, 4).
  • cargo clippy -p dynamo-kv-router --features http,ingest-zmq,replica-sync-zmq,peer-recovery,metrics,testing --all-targets -- -D warnings; cargo check -p dynamo-kv-router --features bench --benches; cargo test -p dynamo-kv-router --features ... (220 + 1 + 1 + 7); cargo test -p dynamo-kv-router --test plugin_api_prelude --test plugin_api_compat (1 + 1).
  • cargo clippy --workspace --all-targets -- -D warnings clean.
  • Hosts alone: cargo check -p dynamo-llm --lib; cargo clippy -p dynamo-llm --all-targets -- -D warnings; cargo test -p dynamo-llm --lib kv_router (485), preprocessor (383 + 2 ignored; the pad re-points), protocols::common (132), http::service::generate (36); cargo clippy -p <p> --tests -- -D warnings for dynamo-mocker, dynamo-bench, dynamo-ext-proc, dynamo-custom-policy-builtin, dynamo-worker-selection-policy-catalog, dynamo-sglang-sidecar, dynamo-vllm-sidecar, dynamo-backend-common, dynamo-sglang-mocker, dynamo-vllm-mocker, dynamo-custom-policy-example-epp, dynamo-custom-policy-example-soft-pin-repin, and libdynamo_llm (the C bindings, a workspace package); lib/bindings/python: cargo clippy --features kv-indexer,slot-tracker,select-service -- -D warnings.
  • bash scripts/router_features_check.sh; bash scripts/router_public_api_check.sh after --update (all six snapshots match); bash scripts/router_layering_check.sh 47 checks, 0 failures and --host 66 checks, 0 failures (44/63 before the new row); python3 .github/codeowners/build_codeowners.py --areas .github/codeowners/areas.yaml --repo . --strict 7549/7549 explicitly owned; cargo fmt --all -- --check; cargo metadata --locked for the root, lib/bindings/python, and lib/bindings/kvbm lockfiles.
  • Move proofs: see the two move-diff summaries in the Summary above (commit 1 from 94513b3f60: 67/67, new 0, dropped 0, MOVE; commit 2 from c108ce9097: 1132 common, new 5 structural lines, dropped 0).
  • Cycle and ownership checks: grep -rn dynamo_router_protocol lib/kv-hashing empty; no dynamo_router_protocol::mm, dynamo_kv_hashing::routing::{pad_value_for_mm_hash, hash_mm_identifier, MM_PAD_*}, or dynamo_kv_events::zmq_wire::{mark,parse}_mm_hash_* path left anywhere under lib/. Target directory 58 GB after the chain, no trim needed.

LocalBlockHash and ExternalSequenceBlockHash are what the hash contract
produces: compute_block_hash and compute_block_hash_for_seq return the
first, and the second is the engine-side identity the router recomputes
with this crate's rules so the two sides agree. Protocol is counterparty
wire and identity only, and the producer owns its outputs, so the two
newtypes move to dynamo-kv-hashing.

Move, text verbatim (git mv lib/router/protocol/src/block_hash.rs to
lib/kv-hashing/src/block_hash.rs; move-diff from 94513b3 over the
file and the kv-hashing root: 67/67 common, new 0, dropped 0; the mod
line and the root re-export are import lines the tool normalizes away):
both structs, From<u64> and From<i64>, the
four manual serde impls, and the two serialization tests. kv-hashing
re-exports both names at the root; routing.rs imports LocalBlockHash
from the crate and its doc link names crate::ExternalSequenceBlockHash.
Protocol drops the module; its crate doc and README table point at
kv-hashing. serde_json stays in protocol's dependencies: the
metadata.rs and worker_type.rs tests still use it, so the documented
exact set (serde, serde_json, thiserror) is unchanged.

Deprecated shims: lib/kv-router/src/protocols.rs and
lib/router/scheduler/src/protocols.rs drop ExternalSequenceBlockHash
and LocalBlockHash (owner decision: no shim for the block hash names).
dynamo_kv_router::LocalBlockHash stays at the crate root, deprecated
as before, now sourced from dynamo_kv_hashing. The plugins prelude
(lib/kv-router/src/plugins/prelude.rs) is the tier-1 plugin API, not a
shim: it keeps ExternalSequenceBlockHash, re-pointed; the kv-indexer
prelude likewise, so the builtin plugin tests and bench compile
unchanged through the prelude.

Re-pointed, compiler-driven: 57 files from
dynamo_router_protocol::block_hash:: to dynamo_kv_hashing:: (lib/llm
20, kv-indexer 10 incl. prelude and bench, bench 9, kv-router 7 incl.
the prelude and the standalone indexer test, mocker 5, kv-events 3,
kv-hints wire.rs, the C and Python bindings), plus the kernel's own
twelve files that took the names through crate::protocols (kv_hints,
local, overlap_refresh, queue, selection/core/{mod,operation,tests},
selection/{input,pending}, selector/policy_tests, tracking_hash,
types) and kv-router's core_host_tests, which import from
dynamo_kv_hashing directly.

Edges: kv-hints gains dynamo-kv-hashing (its wire names
ExternalSequenceBlockHash; the crate was already in its closure through
the indexer); every other importer already depended on kv-hashing.
Gate: the kv-hints row's direct set gains dynamo-kv-hashing; no other
row changes (kv-hashing keeps protocol for the mm types until the next
commit). Three lockfiles: the kv-hints block gains dynamo-kv-hashing.
Docs: kv-hashing crate doc, AGENTS, and README (the LocalBlockHash home
path), protocol crate doc and README table, kv-events AGENTS and
README, kv-hints crate doc, AGENTS, and README, and the lib/router
README rows name the new owner.

Snapshots: protocol 251 -> 236 (the block_hash module, both structs,
From<u64>, From<i64>, the four serde impls and their fns); kv-router
1398 -> 1396 (protocols::ExternalSequenceBlockHash and
protocols::LocalBlockHash gone; the eight compute_seq_hashes_for_
tracking lines now name dynamo_kv_hashing::block_hash::LocalBlockHash);
kv-hints 134 and kv-events 257 change defining paths only (2 and 4
lines); dynamo-error byte-identical. No behavior change. DYNO-190.

Signed-off-by: Ishan Dhanani <ishandhanani@gmail.com>
… engines and the router share

A multimodal block's KV identity is its tokens plus the mm_hash of every
object it touches, and the frontend and the engine must compute it the
same way. The pieces that make them agree were split across three
crates: the per-block and per-request metadata in protocol (mm.rs),
the pad and identifier rules in kv-hashing (routing.rs), and the vLLM
extra-key marker in kv-events (extra_keys.rs). None of them is a
counterparty wire type or an identity every crate names, so protocol
should not hold them, and the pad rules are not hashing. They become
one leaf crate, dynamo-multimodal (lib/multimodal, tier 1), that
depends on serde and xxhash-rust and on no Dynamo crate.

Moves, text verbatim (move-diff from the previous commit over the four
source files and the seven destinations: 1132/1137 common 1132, new 5, dropped 0; the five
new normalized lines are the crate's #![deny(missing_docs)] and the
mod tests { } wrappers of pad.rs and extra_key.rs, nothing else):
  1. lib/router/protocol/src/mm.rs -> lib/multimodal/src/info.rs whole
     (git mv): BlockMmObjectInfo, BlockExtraInfo, RequestMmObjectInfo,
     RequestExtraInfo and to_block_level.
  2. lib/kv-hashing/src/routing.rs -> lib/multimodal/src/pad.rs:
     MM_PAD_SHIFT_VALUE and MM_PAD_HASH_MASK with the SGLang drift
     comment, pad_value_for_mm_hash, hash_mm_identifier, and their
     three tests. routing.rs keeps BlockHashOptions and every
     compute_* and consumes dynamo_multimodal::BlockExtraInfo.
  3. lib/kv-events/src/zmq_wire/extra_keys.rs ->
     lib/multimodal/src/extra_key.rs: mark_mm_hash_for_extra_key,
     parse_mm_hash_from_extra_key, and only_frontend_padded_mm_hashes_
     are_parsed. kv-events keeps DYNAMO_CACHE_SALT_PREFIX and the two
     extra_keys_to_* codec functions (they take the ZMQ wire item) and
     imports the parser from dynamo-multimodal; zmq_wire::mod.rs drops
     the two moved names from its re-export list (no shim).
The crate root is the data path (frontend hash_mm_identifier ->
pad_value_for_mm_hash placeholder tokens for SGLang or the
mark_mm_hash_for_extra_key marker for vLLM; RequestExtraInfo ->
BlockExtraInfo per block -> kv-hashing folds mm_hash into the block
hash; engine events -> kv-events parses the marker back) plus private
modules and root re-exports by name; README, AGENTS, and its
`@AGENTS.md` twin state what it owns, the exact dependency set, and what
stays elsewhere (the kv-events codec and placeholder-run
normalization, kv-hashing's compute_block_hash*, lib/llm's
model-specific mm routing, and kv-hashing's PLH RequestMmObjectInfo, a
different shape with the same name, untouched).

Re-pointed, compiler-driven: kv-hashing routing.rs (import and tests),
kv-events event.rs and zmq_wire/{convert,deserialize,extra_keys,
filter,tests,types}.rs, the kernel's selection/input.rs, kv-router's
scheduling/config.rs and services/selection/tests.rs, lib/llm's
kv_router.rs, prefill_router/query.rs, routing_host/{kv_selection,
request_guard}.rs, publisher/{mod,tests}.rs, preprocessor.rs,
protocols/common.rs, protocols/common/preprocessor.rs, and
http/service/generate.rs, and the Python bindings' llm/kv.rs: every
dynamo_router_protocol::mm::, dynamo_kv_hashing::routing::{pad_value_
for_mm_hash, hash_mm_identifier}, and dynamo_kv_events::zmq_wire::
mark_mm_hash_for_extra_key path now reads dynamo_multimodal::. The
deprecated protocols shims in kv-router and the kernel keep every mm
name (the four structs, the two constants, the two functions),
sourced from dynamo-multimodal; the plugins prelude names none of
them.

Edges: kv-hashing -> multimodal (and drops protocol: nothing left in
the crate names it, verified by grep over src, tests, and benches);
kv-events, scheduler, kv-router, lib/llm, and the Python bindings gain
multimodal; kv-indexer and kv-hints reach it only through kv-hashing;
protocol now has no relation to hashing or to multimodal identity.
Workspace member and workspace dependency added; three lockfiles
follow. Gate: new dynamo-multimodal row (no router deps, every router
crate and transport forbidden, direct deps exactly serde xxhash-rust),
ROUTER_FAMILY, ROUTER_CRATE_DIRS, COMPOSITION_ROUTER_DEPS, and
COMPOSITION_DIRECT_DEPS gain it; kv-hashing row router deps become
dynamo-multimodal with protocol forbidden and the direct set swapping
protocol for multimodal; kv-events and scheduler rows gain it in the
closure and the direct set; kv-indexer and kv-hints rows gain it in
the closure only; protocol, zmq, error, slot-tracker,
session-affinity, worker-selection, and admission rows forbid it.
Codeowners: lib/multimodal/ under the router area plus a router +
multimodal co-ownership glob mirroring extra_keys.rs; CODEOWNERS
regenerated (+2 rules). Docs: protocol crate doc and README table,
kv-hashing AGENTS, kv-events README and AGENTS, lib/router README
(fifteen crates). Sixth public-api snapshot added for the new crate.

Snapshots: multimodal new (19 items: the four structs and their
fields, to_block_level, the two constants, the four functions);
protocol 236 -> 223 (the mm module, the four structs, their fields,
and to_block_level); kv-events 257 -> 255 (mark_mm_hash_for_extra_key
and parse_mm_hash_from_extra_key gone; five lines name
dynamo_multimodal::info::BlockExtraInfo instead of protocol's:
KvCacheStoredBlockData::mm_extra_info, RawKvEvent::BlockStored::
block_mm_infos, StoredBlockOptions::mm_extra_info,
create_stored_blocks, extra_keys_to_block_mm_infos); kv-router
1396, kv-hints 134, and dynamo-error 134 byte-identical (the shims'
mm names render as pub use lines without a defining path). No behavior change. DYNO-190.

Validation: chain /tmp/rr-split/chain-190.sh, log s190-validation.log on
the build host; every stage exit 0 except the pre-existing
kvbm-consolidator manifest failure. clippy default and --all-features
(--all-targets, -D warnings), cargo test --all-features, and rustdoc
-D warnings for multimodal (4), kv-hashing (19 + 17 + 3), protocol (9),
kv-events (64), kv-hints (4), kv-indexer (597 + 2 ignored), scheduler
(289 + 1 ignored); kv-router clippy with all features, bench check,
tests (220 + 1 + 1 + 7), prelude and compat tests (1 + 1); workspace
clippy; hosts alone: lib/llm check, clippy, tests kv_router 485,
preprocessor 383 + 2 ignored, protocols::common 132,
http::service::generate 36; thirteen host packages clippy --tests
including libdynamo_llm; Python bindings clippy with
kv-indexer,slot-tracker,select-service; router_features_check;
router_public_api_check (six snapshots match); router_layering_check
47 checks, 0 failures and --host 66 checks, 0 failures; codeowners
--strict 7549/7549; cargo fmt --check; three lockfiles --locked.

Signed-off-by: Ishan Dhanani <ishandhanani@gmail.com>
@ishandhanani

Copy link
Copy Markdown
Owner Author

Landed upstream as ai-dynamo#18055 (squash commit 79692cf on main, 2026-11-11). Closing this fork review unit.

This branch had an error being deployed

1 failed deployment
external_collaborator — 9e05aaf2 Deployed Nov 2, 2026 by ishandhanani via ok-to-test #510
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

documentation Improvements or additions to documentation frontend refactor router

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant