Skip to content
Closed
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
5 changes: 3 additions & 2 deletions .github/codeowners/areas.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -54,12 +54,13 @@ areas:
- components/src/dynamo/global_router/tests/
- components/src/dynamo/router/
- components/src/dynamo/thunderagent_router/
- lib/kv-events/
- lib/kv-router/
- lib/kv-router/src/indexer/
- lib/kv-router/src/recovery/
- lib/kv-router/src/scheduling/
- lib/kv-router/src/sequences/
- lib/kv-router/src/zmq_wire/
- lib/kv-events/src/zmq_wire/
- lib/kv-router/tests/
- lib/router/
- lib/router/protocol/
Expand Down Expand Up @@ -1060,7 +1061,7 @@ shared:
owners:
- router
- kv-memory
- glob: lib/kv-router/src/zmq_wire/extra_keys.rs
- glob: lib/kv-events/src/zmq_wire/extra_keys.rs
owners:
- router
- multimodal
Expand Down
5 changes: 3 additions & 2 deletions CODEOWNERS
Original file line number Diff line number Diff line change
Expand Up @@ -74,13 +74,14 @@

# === router (@ai-dynamo/dynamo-router-codeowners) ===
/lib/router/ @ai-dynamo/dynamo-router-codeowners
/lib/kv-events/ @ai-dynamo/dynamo-router-codeowners
/lib/kv-router/ @ai-dynamo/dynamo-router-codeowners
/lib/router-plugins/ @ai-dynamo/dynamo-router-codeowners
/lib/kv-router/tests/ @ai-dynamo/dynamo-router-codeowners
/lib/router/protocol/ @ai-dynamo/dynamo-router-codeowners
/lib/kv-router/src/indexer/ @ai-dynamo/dynamo-router-codeowners
/lib/kv-events/src/zmq_wire/ @ai-dynamo/dynamo-router-codeowners
/lib/kv-router/src/recovery/ @ai-dynamo/dynamo-router-codeowners
/lib/kv-router/src/zmq_wire/ @ai-dynamo/dynamo-router-codeowners
/lib/kv-router/src/sequences/ @ai-dynamo/dynamo-router-codeowners
/components/src/dynamo/router/ @ai-dynamo/dynamo-router-codeowners
/lib/kv-router/src/scheduling/ @ai-dynamo/dynamo-router-codeowners
Expand Down Expand Up @@ -737,8 +738,8 @@ requirements.txt
/components/src/dynamo/vllm/cache_info.py @ai-dynamo/dynamo-backend-vllm-codeowners @ai-dynamo/dynamo-kv-memory-codeowners
/container/deps/requirements.frontend.txt @ai-dynamo/dynamo-ops-codeowners @ai-dynamo/dynamo-frontend-codeowners
/deploy/operator/internal/controller/lpx/ @ai-dynamo/dynamo-operator-codeowners @ai-dynamo/dynamo-lpx-codeowners
/lib/kv-events/src/zmq_wire/extra_keys.rs @ai-dynamo/dynamo-router-codeowners @ai-dynamo/dynamo-multimodal-codeowners
/lib/kv-router/src/services/shared_cache/ @ai-dynamo/dynamo-router-codeowners @ai-dynamo/dynamo-kv-memory-codeowners
/lib/kv-router/src/zmq_wire/extra_keys.rs @ai-dynamo/dynamo-router-codeowners @ai-dynamo/dynamo-multimodal-codeowners
/lib/runtime/src/metrics/frontend_perf.rs @ai-dynamo/dynamo-observability-codeowners @ai-dynamo/dynamo-frontend-codeowners
/lib/sidecar/testkit/tests/support/lpx.rs @ai-dynamo/dynamo-runtime-codeowners @ai-dynamo/dynamo-lpx-codeowners @ai-dynamo/dynamo-sidecar-codeowners
/tests/fault_tolerance/migration/utils.py @ai-dynamo/dynamo-fault-tolerance-codeowners @ai-dynamo/dynamo-observability-codeowners
Expand Down
16 changes: 16 additions & 0 deletions Cargo.lock

Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.

2 changes: 2 additions & 0 deletions Cargo.toml
Original file line number Diff line number Diff line change
Expand Up @@ -11,6 +11,7 @@ members = [
"lib/data-gen",
"lib/kv-hashing",
"lib/mocker",
"lib/kv-events",
"lib/kv-router",
"lib/router/protocol",
"lib/global-common",
Expand Down Expand Up @@ -78,6 +79,7 @@ dynamo-renderer = { version = "=8.2.0" }
dynamo-tokens = { path = "lib/tokens", version = "1.7.0" }
dynamo-truthy = { path = "lib/truthy", version = "1.7.0" }
dynamo-data-gen = { path = "lib/data-gen", version = "1.7.0" }
dynamo-kv-events = { path = "lib/kv-events", version = "1.7.0" }
dynamo-kv-hashing = { path = "lib/kv-hashing", version = "1.7.0" }
dynamo-global-common = { path = "lib/global-common", version = "1.7.0" }
dynamo-global-router = { path = "lib/global-router", version = "1.7.0" }
Expand Down
15 changes: 15 additions & 0 deletions lib/bindings/kvbm/Cargo.lock

Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.

15 changes: 15 additions & 0 deletions lib/bindings/python/Cargo.lock

Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.

7 changes: 7 additions & 0 deletions lib/kv-events/AGENTS.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,7 @@
# lib/kv-events

- This crate owns KV cache event types, the `RouterEvent` envelope, the engine ZMQ codec, the replay cursor, and the publisher placement helpers. Nothing else belongs here.
- Depend only on `dynamo-router-protocol`, `dynamo-kv-hashing`, serde, serde_json, rmp-serde, rustc-hash, thiserror, tracing. Never add `dynamo-runtime`, `dynamo-kv-router`, tokio, zmq, axum, reqwest, or prometheus; the gate rejects them.
- Identities and residency vocabulary live in `dynamo-router-protocol`; block hash functions live in `dynamo-kv-hashing::routing`. Import them, do not redefine them.
- Changing a wire shape here changes what engines and sidecars publish. Keep serde compatibility tests next to the type.
- Run `scripts/router_layering_check.sh` before committing.
1 change: 1 addition & 0 deletions lib/kv-events/CLAUDE.md
Original file line number Diff line number Diff line change
@@ -0,0 +1 @@
@AGENTS.md
24 changes: 24 additions & 0 deletions lib/kv-events/Cargo.toml
Original file line number Diff line number Diff line change
@@ -0,0 +1,24 @@
[package]
name = "dynamo-kv-events"
description = "KV cache event types, the engine ZMQ codec, and the replay cursor shared by Dynamo publishers and the router"
version.workspace = true
edition.workspace = true
authors.workspace = true
license.workspace = true
homepage.workspace = true
repository.workspace = true
keywords.workspace = true
readme = "README.md"

[dependencies]
dynamo-kv-hashing = { workspace = true }
dynamo-router-protocol = { workspace = true }
rmp-serde = { workspace = true }
rustc-hash = "2.1.1"
serde = { workspace = true }
serde_json = { workspace = true }
thiserror = { workspace = true }
tracing = { workspace = true }

[dev-dependencies]
rstest = "0.18.2"
12 changes: 12 additions & 0 deletions lib/kv-events/README.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,12 @@
<!--
SPDX-FileCopyrightText: Copyright (c) 2026 NVIDIA CORPORATION & AFFILIATES. All rights reserved.
SPDX-License-Identifier: Apache-2.0
-->

# dynamo-kv-events

Everything about KV cache events, for both ends of the wire: the event types and the `RouterEvent` envelope (`event`), the engine ZMQ msgpack codec and its filters (`zmq_wire`), the replay cursor a subscriber keeps in step with a publisher (`cursor`), and the publisher-side placement helpers (`placement`). Workers, sidecars, and the C bindings publish with this crate; the router's indexer ingests with it.

Dependencies: `dynamo-router-protocol` (identities, residency vocabulary, block-hash newtypes, multimodal block info), `dynamo-kv-hashing` (the block hash contract the codec recomputes), serde, serde_json, rmp-serde, rustc-hash, thiserror, tracing. No sockets, tasks, or servers: the ZMQ socket is `dynamo-zmq` and the listener that drives it is a `dynamo-kv-router` adapter. The layering gate (`scripts/router_layering_check.sh`) checks the dependency set.

Part of the router split (see `lib/router/README.md`).
File renamed without changes.
Loading
Loading