Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
29 changes: 19 additions & 10 deletions Cargo.lock

Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.

5 changes: 3 additions & 2 deletions Cargo.toml
Original file line number Diff line number Diff line change
Expand Up @@ -13,10 +13,11 @@ members = [
"lib/mocker",
"lib/kv-router",
"lib/router-plugins/catalog",
"examples/router/custom-policy-example/basic",
"examples/router/custom-policy-example/simple-filter-score-pick",
"examples/router/custom-policy-example/catalog",
"examples/router/custom-policy-example/disaggregated",
"examples/router/custom-policy-example/disagg-filter-score-pick",
"examples/router/custom-policy-example/epp",
"examples/router/custom-policy-example/simple-stacked-score-pick",
"lib/memory",
"lib/kvbm-common",
"lib/kvbm-config",
Expand Down

Large diffs are not rendered by default.

8 changes: 4 additions & 4 deletions docs/fern/pages/reference/api/python/README.mdx
Original file line number Diff line number Diff line change
Expand Up @@ -7,14 +7,14 @@ subtitle: Public Python surfaces on the Dynamo distributed runtime, statically d

{/* GENERATED by docs/fern/scripts/gen_python_api.py -- do not edit. */}

Dynamo publishes 11 Python modules with 362 public class and function symbols under `dynamo.*`.
Dynamo publishes 11 Python modules with 365 public class and function symbols under `dynamo.*`.

<CardGroup cols={2}>
<Card title="dynamo._core" href="python/_core">88 symbols. Rust-backed distributed runtime, KV router, and endpoint bindings.</Card>
<Card title="dynamo._core" href="python/_core">89 symbols. Rust-backed distributed runtime, KV router, and endpoint bindings.</Card>
<Card title="dynamo.runtime" href="python/runtime">17 symbols. Decorators and re-exports for defining Dynamo workers and endpoints.</Card>
<Card title="dynamo.llm" href="python/llm">46 symbols. High-level LLM primitives for building request pipelines.</Card>
<Card title="dynamo.llm" href="python/llm">47 symbols. High-level LLM primitives for building request pipelines.</Card>
<Card title="dynamo.frontend" href="python/frontend">43 symbols. OpenAI-compatible HTTP frontend, argument parsing, and pre/post-processing.</Card>
<Card title="dynamo.common" href="python/common">79 symbols. Shared configuration groups, storage adapters, and utility helpers.</Card>
<Card title="dynamo.common" href="python/common">80 symbols. Shared configuration groups, storage adapters, and utility helpers.</Card>
<Card title="dynamo.health_check" href="python/health_check">2 symbols. Health-check payload types and environment-driven configuration.</Card>
<Card title="dynamo.logits_processing" href="python/logits_processing">4 symbols. Custom logits processors for LLM token generation.</Card>
<Card title="dynamo.planner" href="python/planner">36 symbols. Scaling connectors, decision types, and Planner configuration.</Card>
Expand Down
201 changes: 109 additions & 92 deletions docs/fern/pages/reference/api/python/_core.mdx

Large diffs are not rendered by default.

16 changes: 15 additions & 1 deletion docs/fern/pages/reference/api/python/common.mdx
Original file line number Diff line number Diff line change
Expand Up @@ -7,7 +7,7 @@ subtitle: Shared configuration groups, storage adapters, and utility helpers.

{/* GENERATED by docs/fern/scripts/gen_python_api.py -- do not edit. */}

`dynamo.common` publishes 50 classes and 29 functions. Source: [`components/src/dynamo/common/__init__.py`](https://github.com/ai-dynamo/dynamo/blob/main/components/src/dynamo/common/__init__.py)
`dynamo.common` publishes 50 classes and 30 functions. Source: [`components/src/dynamo/common/__init__.py`](https://github.com/ai-dynamo/dynamo/blob/main/components/src/dynamo/common/__init__.py)

<Accordion id="api-dynamo-common-multimodal-embedding-transfer-abstractembeddingreceiver" title="AbstractEmbeddingReceiver (class)">
Abstract base class for a receiver of precomputed embeddings from the encode worker.
Expand Down Expand Up @@ -2679,6 +2679,20 @@ return &#123;"field": obj.field&#125;
[`components/src/dynamo/common/config_dump/config_dumper.py#L209`](https://github.com/ai-dynamo/dynamo/blob/main/components/src/dynamo/common/config_dump/config_dumper.py#L209)
</Accordion>

<Accordion id="api-dynamo-common-model-taints-register-model-taint-route" title="register_model_taint_route (function)">
Register POST /engine/update/model_taints on the system status server.

```python
from dynamo.common.model_taints import register_model_taint_route
```

```python
register_model_taint_route(runtime: DistributedRuntime, endpoint: Endpoint) -> None
```

[`components/src/dynamo/common/model_taints.py#L17`](https://github.com/ai-dynamo/dynamo/blob/main/components/src/dynamo/common/model_taints.py#L17)
</Accordion>

<Accordion id="api-dynamo-common-rl-admin-register-rl-routes" title="register_rl_routes (function)">
Register worker system routes and optionally expose route descriptors.

Expand Down
Loading
Loading