Skip to content

docs(use-cases): use case guides refactor - #16607

Merged
harryskim merged 34 commits into
ai-dynamo:mainfrom
akshatha-k:usecase-guides-refactor
Nov 5, 2026
Merged

harryskim merged 34 commits into
ai-dynamo:mainfrom
akshatha-k:usecase-guides-refactor

Conversation

@akshatha-k

@akshatha-k akshatha-k commented Oct 16, 2026 •

Copy link
Copy Markdown
Contributor

Closes DGH-2446

Overview

Restructures the Use Cases tab by workload and modality (Image Understanding, Video Understanding, Speech, Diffusion, GPU Sharing) and rewrites the Agents guides as task-based guides. Opened as a draft to get the Fern preview.

Details

1. Navigation and structure

  • Use Cases sidebar reorganized by workload, one level deep, with a new Use Cases overview.
  • Final nav: Overview · Reinforcement Learning · Agents · Image Understanding · Video Understanding · Speech · Diffusion · GPU Sharing.
  • Image Understanding and Video Understanding replace the Image and Video sections. Each has an Overview and ends with a Performance Optimizations section.
  • New Diffusion section: Overview, FastVideo, Text to Image, Text to Video, Image to Video.
  • "Speech & Audio" is now Speech, placed before Diffusion. "Image Generation" is now Text to Image (/diffusion/text-to-image).
  • Multimodal Performance is removed.

2. New and consolidated pages

  • New pages: Use Cases overview, Image Understanding, Video Understanding, Speech to Speech, Speech to Text.
  • Text to Video has a tutorials table and the MiniMax-H3 tutorial. FastVideo and Exact Video KV Routing are separate pages. Video Decode GPU Requirements is now Video Decoding and GPU Requirements.
  • VLM Performance Optimization (under Image Understanding) is a section. Its overview page has a request-flow diagram, a "when each feature helps" table, and a support matrix. It has one subpage each for multimodal KV routing, frontend media decoding, the shared image cache, the embedding cache, and encoder disaggregation. Old multimodal URLs redirect to the matching subpage.
  • Speech Recognition and Audio Understanding become a single Speech to Text page.
  • GPU Sharing (renamed from Many-Model Serving) is one page: Setup, experimental benchmark results, "How to Read the Benchmark", and Reproducing the Results. The deploy, build-forks, and MPS guides move to examples/gpu-sharing/docs/ and are linked from that README.
  • Additional Media Decoders moves to Developer Guide > Developing and Extending Dynamo.
  • Reinforcement Learning lists framework integrations first.

3. Agents guides rewritten as task-based guides

  • The Agents overview is organized around goals, with an "I want to…" table. New Run an Agent on Dynamo guide starts a local endpoint, connects a harness, and checks the request trace.
  • Identify Agent Sessions (was Session IDs) now also holds the captured agent-header rules moved out of Agent Harnesses.
  • Maintain Session Affinity is new: enabling the TTL, hard vs. soft binding, subagent binding, and a trace check.
  • Prioritize Requests merges Agent Hints and Priority Scheduling: send a priority, enable each layer (router queue, engine, cache eviction), verify, troubleshoot. It uses the router policy file instead of the deprecated --router-queue-threshold and --router-queue-policy flags.
  • Agent Tracing leads with the capture steps. Agent Simulation is the renamed Agent Trace Replay.
  • ThunderAgent Program Scheduler leads with when to use it and the native plugin. The Python prototype moves to ThunderAgent Python Router.
  • Examples corrected against the code: trace and tool-event records use session_id / parent_session_id (not trajectory_id), DYN_REQUEST_TRACE_FILE_PATH replaces the deprecated DYN_REQUEST_TRACE_OUTPUT_PATH, and trace segments are named request-trace.000000.jsonl.gz.
  • Redirects added for the old session-i-ds, agent-hints, and priority-scheduling URLs.

4. Content fixes

  • Text to Video (TensorRT-LLM): launch sets --served-model-name wan_t2v.
  • Text to Speech: documents chunked streaming and voice cloning.
  • Image to Video (SGLang): adds a working input_reference request.
  • Encoder Disaggregation: TensorRT-LLM supports E/PD.
  • Tool Call Parsing: adds kimi_k3, deepseek_v41, and muse_glimmer. A stale dynamo-parsers-v2 paragraph is removed.

5. Moves out of Use Cases

  • Tool Calling & Reasoning → Developer Guide > Frontend.
  • LLM diffusion → Developer Guide > Backends > SGLang.
  • Additional Media Decoders → Developer Guide (see above).

6. Links, redirects, assets

  • Includes the dead-link redirect set from fix(docs): repair dead links and redirect dead paths across published versions #16792 (exact redirects for dead paths linked from published versions, cherry-picked as docs: redirect dead docs paths linked from published versions). One entry, the v1.2.0 priority-scheduling redirect, is retargeted to the renamed Prioritize Requests page.
  • Dev-scoped redirects for every moved URL, and existing redirects retargeted. /many-model-serving/* redirects to /gpu-sharing. Redirect sources that are now real pages are removed.
  • Links updated in the developer guide, reference, recipes, example READMEs, and lib/llm/src/preprocessor/media/README.md.
  • The VLM diagram is docs/fern/assets/img/vlm-request-path.svg.

Where the reviewer should start

  • docs/fern/index.yml (Use Cases tab)
  • docs/fern/pages/use-cases/image-understanding/vlm-performance-optimization.md and the five pages under vlm-performance-optimization/
  • docs/fern/pages/use-cases/gpu-sharing/overview.mdx and examples/gpu-sharing/
  • docs/fern/pages/use-cases/agents/overview.md and run-an-agent-on-dynamo.md
  • docs/fern/docs.yml (redirect blocks)

Validation

  • python3 docs/fern/scripts/docs_lint.py: 0 errors.
  • fern check: 0 errors.
  • fern docs broken-links: 1 error in pages/recipes/model-recipes/deepseek-v4-pro-0813.mdx, which this PR does not touch.
  • Not run on GPUs. Commands on the pages come from the repo's launch scripts and recipes.

Needs owner review

  • Image to Video (SGLang) uses an <image-to-video-model> placeholder; the repo names no supported checkpoint.
  • The voice cloning example uses Qwen/Qwen3-TTS-12Hz-1.7B-Base (name taken from a test fixture).
  • The zh-CN Tool Call Parsing translation does not include the three new parser entries.
  • A few wildcard redirects now reach their targets in two hops.
  • The GPU Sharing intro names MIG, but the page has no MIG definition or benchmark.

🤖 Generated with Claude Code

akshatha-k and others added 6 commits October 14, 2026 14:46
Restructure the Use Cases tab so every section is one level deep:
Overview, Reinforcement Learning, Agents, Image, Video, Speech & Audio,
Multimodal Performance, and Many-Model Serving.

- Split Multimodal Serving and Diffusion into Image, Video, and Speech &
  Audio sections that cover both understanding and generation, plus a
  Multimodal Performance section for the shared image/video features.
- Add Image Understanding, Video Understanding, Speech Recognition, Audio
  Understanding, Speech-to-Speech, a Use Cases overview, a Multimodal
  Performance overview, a Many-Model overview, and a Common Setup page.
- Keep backend setup in Use Cases: "Set up the backend" tabs on the first
  page of each section, shared through _snippets/.
- Split FastVideo, MiniMax-H3, and exact video KV routing into their own
  pages; merge Additional Media Decoders into Video Decoding.
- Reorder RL (integrations first) and Agents (harness, session, hints,
  tracing, replay, ThunderAgent, priority).
- Move Tool Calling & Reasoning to Developer Guide > Frontend and LLM
  diffusion to Developer Guide > Backends > SGLang.
- Add dev-scoped redirects for every moved URL and retarget existing ones.

P0 fixes: agent tool-event wire format, replay segment file name, agent
harness trace path, TensorRT-LLM text-to-video model name, TTS streaming
and voice cloning, SGLang image-to-video request, TensorRT-LLM E/PD
support, missing tool-call parsers, stale parser crate version.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Signed-off-by: harryk <harryk@nvidia.com>
Signed-off-by: Harry Kim <harryk@nvidia.com>
Signed-off-by: akshatha-k <akshutk@gmail.com>
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Signed-off-by: Harry Kim <harryk@nvidia.com>
Signed-off-by: akshatha-k <akshutk@gmail.com>
Put the MiniMax-H3 (T2VA) tutorial ahead of the standard text-to-video
guide on one page, with a tutorials table at the top linking to both.
Rename the pages Text to Video (T2V) and Image to Video (I2V), keeping
their URLs.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Signed-off-by: Harry Kim <harryk@nvidia.com>
Signed-off-by: akshatha-k <akshutk@gmail.com>
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Signed-off-by: Harry Kim <harryk@nvidia.com>
Signed-off-by: akshatha-k <akshutk@gmail.com>
…page

Upstream ai-dynamo#16350 added a link to the old diffusion/workflows/text-to-image.md
path, which the Use Cases restructure moves to image/image-generation.md.

Signed-off-by: akshatha-k <akshutk@gmail.com>
…ith Speech to Text

Merge the two speech pages into one Speech to Text guide and verify its
content against the vLLM realtime transcription handler, the frontend
/v1/realtime route, the launch script and client, and the Nemotron ASR
adapter. The launcher defaults --hf-overrides for the default model, the
worker accepts 24 kHz PCM16 and English only, and the guide documents the
session limits, error events, and the Nemotron adapter's differences.

Drop the Audio Understanding page and its unverified support matrix, and
point readers at the vLLM multimodal guide for audio_url requests.

Signed-off-by: akshatha-k <akshutk@gmail.com>
@akshatha-k
akshatha-k temporarily deployed to external_collaborator October 16, 2026 00:17 — with GitHub Actions Inactive
@akshatha-k
akshatha-k temporarily deployed to external_collaborator October 16, 2026 00:17 — with GitHub Actions Inactive
@github-actions

github-actions Bot commented Oct 16, 2026 •

Copy link
Copy Markdown
Contributor

@github-actions github-actions Bot added the docs label Oct 16, 2026
@github-actions github-actions Bot added the external-contribution Pull request is from an external contributor label Oct 16, 2026
@dynamo-ops

Copy link
Copy Markdown
Contributor

/ok to test d494bfb

@github-actions github-actions Bot added documentation Improvements or additions to documentation backend::vllm Relates to the vllm backend frontend `python -m dynamo.frontend` and `dynamo-run in=http|text|grpc` xpu labels Oct 16, 2026
@akshatha-k akshatha-k removed the external-contribution Pull request is from an external contributor label Oct 16, 2026
…ections

Restructure the Use Cases tab:

- Rename the Image and Video sections to Image Understanding and Video
  Understanding. Each starts with an Overview page, and ends with a
  Performance Optimizations section that links to the VLM page.
- Remove the Multimodal Performance section. Add "VLM Performance
  Optimization" under Image Understanding with an end-to-end VLM request
  flow diagram, a table of when each feature helps, and collapsible
  sections for multimodal KV routing, frontend media decoding, the shared
  image cache, the embedding cache, and encoder disaggregation.
- Keep Custom Vision Encoders as a page inside Image Understanding.
- Move generation content (image generation, text to video, image to
  video, FastVideo) into a new top-level Diffusion section with an
  overview page.
- Update nav, links, and redirects for every moved page.

Co-Authored-By: Claude Sonnet 5.5 <noreply@anthropic.com>
Signed-off-by: akshatha-k <akshutk@gmail.com>
@akshatha-k
akshatha-k temporarily deployed to external_collaborator October 16, 2026 00:57 — with GitHub Actions Inactive
@dynamo-ops

Copy link
Copy Markdown
Contributor

/ok to test 5cf311a

@devin-ai-integration

devin-ai-integration Bot commented Oct 16, 2026 •

Copy link
Copy Markdown
Contributor

✅ Dynamo PR CI passed — run 42105782614 (attempt 1) on 7f36999eee

Gate checks: ✅ backend-status-check · ✅ deploy-status-check · ✅ dynamo-status-check

Posted automatically by Devin for run 42105782614. Updated on every full-CI run of this PR.

Use the NVIDIA green and white palette with blue highlights on a white
background, and move the image to docs/fern/assets/img/ per the
documentation style guide.

Co-Authored-By: Claude Sonnet 5.5 <noreply@anthropic.com>
Signed-off-by: akshatha-k <akshutk@gmail.com>
@akshatha-k
akshatha-k temporarily deployed to external_collaborator October 16, 2026 17:31 — with GitHub Actions Inactive
@dynamo-ops

Copy link
Copy Markdown
Contributor

/ok to test d49a460

… diagram

- Rename Image Generation to Text to Image (file, URL, nav, links, and
  redirects) to match Text to Video.
- Put FastVideo right below the Diffusion overview and add a pointer to it
  at the top of Text to Video.
- Drop the Diffusion overview intro so it opens with the guides table.
- Rename the "Speech and Audio" label to "Speech".
- Reword the VLM Performance Optimization intro.
- Redraw the VLM request path diagram with the pipeline in blue and the
  optional features in green with dotted arrows.

Co-Authored-By: Claude Sonnet 5.5 <noreply@anthropic.com>
Signed-off-by: akshatha-k <akshutk@gmail.com>
@akshatha-k
akshatha-k temporarily deployed to external_collaborator October 16, 2026 17:46 — with GitHub Actions Inactive
@dynamo-ops

Copy link
Copy Markdown
Contributor

/ok to test 363e458

akshatha-k and others added 2 commits October 17, 2026 15:09
…rder sections

- Revert kv-cache-offloading and agent-harnesses/simulation/tracing pages to main
- Move Additional Media Decoders to Developer Guide > Developing and Extending Dynamo
- Collapse GPU Sharing into one overview page with setup, experimental
  benchmark results, and a how-to-read accordion; move the deploy and MPS
  guides to examples/gpu-sharing/docs and link them from the README
- Add redirects for the old many-model-serving pages
- Move Speech above Diffusion in the Use Cases nav and overview table
- Remove the Deployment Notation section from VLM Performance Optimization

Co-Authored-By: Claude Sonnet 5.5 <noreply@anthropic.com>
Signed-off-by: akshatha-k <akshutk@gmail.com>
Co-Authored-By: Claude Sonnet 5.5 <noreply@anthropic.com>
Signed-off-by: akshatha-k <akshutk@gmail.com>
@dynamo-ops

Copy link
Copy Markdown
Contributor

/ok to test ac7ce05

Use one green accent for components, a single arrow color, gray for paths not taken,
and amber only for state. Replace generic icons with component-specific ones and drop
the diagram eyebrow labels.

Co-Authored-By: Claude Sonnet 5.5 <noreply@anthropic.com>
Signed-off-by: akshatha-k <akshutk@gmail.com>
@akshatha-k
akshatha-k temporarily deployed to external_collaborator November 2, 2026 07:09 — with GitHub Actions Inactive
@dynamo-ops

Copy link
Copy Markdown
Contributor

/ok to test 1c29d8f

@harryskim harryskim self-assigned this Nov 5, 2026
Resolve conflicts with main and carry main's doc changes into the
reorganized Use Cases layout.

- Keep main's prose in developer-guide and reference pages and point
  their links at the moved use-case pages.
- Port main's edits into pages this branch moved: EDF default queue
  policy and the flat policy-class schema (priority scheduling), SGLang
  wide-token routing fallback (image and video KV routing), and
  Cosmos3 / rejected file:// references.
- Restore main's Diffusion overview and workflow pages, with Workflows
  open by default and FastVideo as the first Text-to-Video tab.
  Text-to-Speech stays under Speech.
- Convert GitHub-style callouts on the Diffusion pages to Fern
  components so they render in previews.
- Fix links main added to moved paths, and realign redirects so every
  diffusion redirect lands on a live page.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Signed-off-by: akshatha-k <akshutk@gmail.com>
@akshatha-k
akshatha-k temporarily deployed to external_collaborator November 5, 2026 19:20 — with GitHub Actions Inactive
@dynamo-ops

Copy link
Copy Markdown
Contributor

/ok to test 954aa1a

Bring the branch up to date with main (planner retune scaling policy, batch gateway docs). No conflicts.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Signed-off-by: akshatha-k <akshutk@gmail.com>
@akshatha-k
akshatha-k temporarily deployed to external_collaborator November 5, 2026 19:22 — with GitHub Actions Inactive
@dynamo-ops

Copy link
Copy Markdown
Contributor

/ok to test bfc4463

…rser entries

Main already lists kimi_k3 and deepseek_v41 with fuller notes; keep those
and fold in the recipe links from the duplicates.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Signed-off-by: akshatha-k <akshutk@gmail.com>
@akshatha-k
akshatha-k temporarily deployed to external_collaborator November 5, 2026 20:41 — with GitHub Actions Inactive
@dynamo-ops

Copy link
Copy Markdown
Contributor

/ok to test 7f36999

@harryskim harryskim left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

approve

@harryskim harryskim left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

lgtm

@harryskim
harryskim merged commit e470add into ai-dynamo:main Nov 5, 2026
119 checks passed
Jont828 added a commit to Jont828/dynamo that referenced this pull request Nov 6, 2026
Rebasing onto main picked up the use case guides refactor (ai-dynamo#16607), which
moved or replaced pages this PR links to or renames into:

- multimodal-serving/voice.md was replaced by speech/voice-pipelines.md.
  The Speech Recognition on Kubernetes section now lives there (ported
  during conflict resolution), so point the vLLM multimodal guide and
  examples/backends/vllm/deploy/README.md at the new page and anchors.
- multimodal-serving/additional-media-decoders.md moved to
  image-understanding/additional-media-decoders.md; update the link in
  the vLLM multimodal guide.
- The new speech/speech-to-text.md page launches the realtime ASR worker
  with agg_realtime_transcription.sh, which this PR renames to
  agg_asr_realtime.sh; apply the same rename there.

Automated-by: pr-shepherd
Signed-off-by: Jonathan Tong <jt572@cornell.edu>
Jont828 added a commit to Jont828/dynamo that referenced this pull request Nov 6, 2026
Rebasing onto main picked up the use case guides refactor (ai-dynamo#16607), which
moved pages that the migrated example pages link to:

- diffusion/workflows/text-to-audio.md moved to speech/text-to-speech.md.
  Main updated the Audex link in recipes/cli-templates/vllm.mdx, which
  this PR removes; port that change to audio-generation.mdx, the page
  that now carries the Qwen3-TTS and Audex guidance, and use the new
  page title as link text.
- use-cases/gpu-sharing/gpu-sharing-results.mdx was folded into
  use-cases/gpu-sharing/overview.mdx, and the deploy-*.md guides moved
  out of the docs site to examples/gpu-sharing/docs/. Point
  gpu-sharing.mdx at the overview page and at the guides on GitHub, as
  the overview page does.

Automated-by: pr-shepherd
Signed-off-by: Jonathan Tong <jt572@cornell.edu>
ishandhanani added a commit to ishandhanani/dynamo that referenced this pull request Nov 6, 2026
Twenty-six upstream commits. Conflicts in eight paths, resolved into the
owner crates; everything else merged by path.

- ai-dynamo#17910 strict boolean worker flags: lib/router/scheduler/src/selection/types.rs (kernel WorkerRequest and WorkerPatchRequest take strict_bool on is_eagle and engine_owned_mm_identity; carried by rename detection), lib/bindings/python/tests/test_kv_bindings.py.
- ai-dynamo#18240 configurable session-affinity entry limit: lib/llm/src/session_affinity/mod.rs reads SessionAffinityConfig and MAX_SESSION_AFFINITY_ENTRIES from dynamo_session_affinity::host (the host contract now exports the entry limit), coordinator.rs and kv_router/embedded.rs build the table through affinity_config; frontend args, env names, docs and Python tests auto-merged.
- ai-dynamo#18145 EPP co-ownership: .github/codeowners/areas.yaml globs re-pointed to the moved files (lib/router/kv-router/src/plugins/registry.rs; lib/router/kv-router/src/scheduling/config.rs plus the kernel slice lib/router/scheduler/src/config.rs; the pre-split services/selection top level as lib/router/scheduler/src/selection/*, lib/router/kv-router/src/services/selection/* and lib/router/session-affinity/src/lib.rs, core/ stays router-only); the lib/llm, router-policies and example globs auto-merged; CODEOWNERS regenerated.
- ai-dynamo#17708 nvtx in pre-merge CI: .github/workflows/pre-merge.yml gains "Run NVTX feature tests" after the stack's kv-router adapter and canonical replay steps and "Lint the NVTX feature" in rust-clippy; Cargo.toml profiling comment, pyproject.toml.
- ai-dynamo#17623 dependency bumps: lib/mocker/Cargo.toml adds zip next to the stack's fastrand; lib/llm/Cargo.toml utoipa-swagger-ui 10.0.2; the root, python-bindings and kvbm lockfiles taken from upstream and regenerated.
- ai-dynamo#17675 DynamoDB-backed global session affinity: lib/global-router, lib/global-frontend, new lib/global-router-store-dynamodb workspace member.
- ai-dynamo#18278 synthetic session prompts in replay: lib/mocker/src/replay/entrypoints.rs, lib/bindings/python/rust/llm/replay.rs, _core.pyi, components replay package and tests.
- ai-dynamo#16607 use-case docs refactor: docs/fern; multimodal-kv-routing.md moved to use-cases/image-understanding/vlm-performance-optimization/ and the stack's DYN_LOG directive (dynamo_scheduler, dynamo_admission, dynamo_worker_selection) carried to the new path.
- ai-dynamo#17706 NVTX ranges on the OpenAI HTTP path, ai-dynamo#17626 beam tool constraints, ai-dynamo#18015 MiniMax SSE keep-alive: lib/llm, auto-merged.
- ai-dynamo#18229 Velo in-place encoding: lib/runtime. ai-dynamo#17370 SGLang first-chunk logprobs: lib/generate-formats.
- ai-dynamo#17862 vLLM 0.33.0 bump: container, components, lib/sidecar/vllm, pyproject.
- ai-dynamo#18121, ai-dynamo#18154, ai-dynamo#18111 planner live retune; ai-dynamo#18234 Hunyuan reasoning defaults; ai-dynamo#17229 TRT-LLM KVBM removal: components, tests, bindings Python, docs.
- ai-dynamo#18069, ai-dynamo#18066 operator; ai-dynamo#18244 recipes; ai-dynamo#18210 batch docs; three automated community-events refreshes.

Signed-off-by: Ishan Dhanani <ishandhanani@gmail.com>
Jont828 added a commit to Jont828/dynamo that referenced this pull request Nov 6, 2026
Rebasing onto main picked up the use case guides refactor (ai-dynamo#16607), which
moved pages that the migrated example pages link to:

- diffusion/workflows/text-to-audio.md moved to speech/text-to-speech.md.
  Main updated the Audex link in recipes/cli-templates/vllm.mdx, which
  this PR removes; port that change to audio-generation.mdx, the page
  that now carries the Qwen3-TTS and Audex guidance, and use the new
  page title as link text.
- use-cases/gpu-sharing/gpu-sharing-results.mdx was folded into
  use-cases/gpu-sharing/overview.mdx, and the deploy-*.md guides moved
  out of the docs site to examples/gpu-sharing/docs/. Point
  gpu-sharing.mdx at the overview page and at the guides on GitHub, as
  the overview page does.

Automated-by: pr-shepherd
Signed-off-by: Jonathan Tong <jt572@cornell.edu>
Jont828 added a commit to Jont828/dynamo that referenced this pull request Nov 6, 2026
…hanges

Adjustments for upstream changes that landed after this branch's old
merge base and that the rebase does not catch as conflicts:

- Qwen3-ASR example (ai-dynamo#15671) added deploy/agg_asr.yaml,
  deploy/agg_asr_realtime.yaml, and launch/agg_asr.sh under
  examples/backends/vllm, and renamed launch/agg_realtime_transcription.sh
  to agg_asr_realtime.sh. Embed the three new sources on the Audio and
  Realtime Serving page, with the audio-transfer and image notes upstream
  added to the vLLM deploy README, follow the rename (also the change
  upstream made in the removed vLLM CLI template), and update the card
  keywords on the overview and Workloads pages.
- The use-case refactor (ai-dynamo#16607) moved diffusion/workflows/text-to-audio.md
  to speech/text-to-speech.md. Point the Audio Generation links, and their
  text, at the new page.
- ai-dynamo#16607 moved the GPU sharing walkthroughs from use-cases/gpu-sharing/
  into examples/gpu-sharing/docs/ and replaced gpu-sharing-results.mdx
  with overview.mdx. Retarget the GPU Sharing example page, linking the
  walkthroughs on GitHub, and describe the README as this branch now
  shapes it: a file list that links each configuration's guide.
- ai-dynamo#16607 deleted use-cases/multimodal-serving/voice.md and moved its
  content to speech/voice-pipelines.md and speech/speech-to-text.md. Carry
  over this branch's change to voice.md: point the Nemotron deployment and
  external-orchestration links at the migrated Nemotron Speech Pipeline
  page instead of README anchors this branch removes.
- ai-dynamo#18210 added a concurrency and result-delivery tuning section to the
  batch-gateway README, whose content this branch moved to
  offline-batch-inference.md. Port the section there, with Title Case
  headings to match the page and the working directory stated as
  elsewhere on the page.

Signed-off-by: Jonathan Tong <jt572@cornell.edu>
Automated-by: pr-shepherd
Jont828 added a commit to Jont828/dynamo that referenced this pull request Nov 9, 2026
…hanges

Adjustments for upstream changes that landed after this branch's old
merge base and that the rebase does not catch as conflicts:

- Qwen3-ASR example (ai-dynamo#15671) added deploy/agg_asr.yaml,
  deploy/agg_asr_realtime.yaml, and launch/agg_asr.sh under
  examples/backends/vllm, and renamed launch/agg_realtime_transcription.sh
  to agg_asr_realtime.sh. Embed the three new sources on the Audio and
  Realtime Serving page, with the audio-transfer and image notes upstream
  added to the vLLM deploy README, follow the rename (also the change
  upstream made in the removed vLLM CLI template), and update the card
  keywords on the overview and Workloads pages.
- The use-case refactor (ai-dynamo#16607) moved diffusion/workflows/text-to-audio.md
  to speech/text-to-speech.md. Point the Audio Generation links, and their
  text, at the new page.
- ai-dynamo#16607 moved the GPU sharing walkthroughs from use-cases/gpu-sharing/
  into examples/gpu-sharing/docs/ and replaced gpu-sharing-results.mdx
  with overview.mdx. Retarget the GPU Sharing example page, linking the
  walkthroughs on GitHub, and describe the README as this branch now
  shapes it: a file list that links each configuration's guide.
- ai-dynamo#16607 deleted use-cases/multimodal-serving/voice.md and moved its
  content to speech/voice-pipelines.md and speech/speech-to-text.md. Carry
  over this branch's change to voice.md: point the Nemotron deployment and
  external-orchestration links at the migrated Nemotron Speech Pipeline
  page instead of README anchors this branch removes.
- ai-dynamo#18210 added a concurrency and result-delivery tuning section to the
  batch-gateway README, whose content this branch moved to
  offline-batch-inference.md. Port the section there, with Title Case
  headings to match the page and the working directory stated as
  elsewhere on the page.

Signed-off-by: Jonathan Tong <jt572@cornell.edu>
Automated-by: pr-shepherd
Jont828 added a commit to Jont828/dynamo that referenced this pull request Nov 10, 2026
…hanges

Adjustments for upstream changes that landed after this branch's old
merge base and that the rebase does not catch as conflicts:

- Qwen3-ASR example (ai-dynamo#15671) added deploy/agg_asr.yaml,
  deploy/agg_asr_realtime.yaml, and launch/agg_asr.sh under
  examples/backends/vllm, and renamed launch/agg_realtime_transcription.sh
  to agg_asr_realtime.sh. Embed the three new sources on the Audio and
  Realtime Serving page, with the audio-transfer and image notes upstream
  added to the vLLM deploy README, follow the rename (also the change
  upstream made in the removed vLLM CLI template), and update the card
  keywords on the overview and Workloads pages.
- The use-case refactor (ai-dynamo#16607) moved diffusion/workflows/text-to-audio.md
  to speech/text-to-speech.md. Point the Audio Generation links, and their
  text, at the new page.
- ai-dynamo#16607 moved the GPU sharing walkthroughs from use-cases/gpu-sharing/
  into examples/gpu-sharing/docs/ and replaced gpu-sharing-results.mdx
  with overview.mdx. Retarget the GPU Sharing example page, linking the
  walkthroughs on GitHub, and describe the README as this branch now
  shapes it: a file list that links each configuration's guide.
- ai-dynamo#16607 deleted use-cases/multimodal-serving/voice.md and moved its
  content to speech/voice-pipelines.md and speech/speech-to-text.md. Carry
  over this branch's change to voice.md: point the Nemotron deployment and
  external-orchestration links at the migrated Nemotron Speech Pipeline
  page instead of README anchors this branch removes.
- ai-dynamo#18210 added a concurrency and result-delivery tuning section to the
  batch-gateway README, whose content this branch moved to
  offline-batch-inference.md. Port the section there, with Title Case
  headings to match the page and the working directory stated as
  elsewhere on the page.

Signed-off-by: Jonathan Tong <jt572@cornell.edu>
Automated-by: pr-shepherd
Jont828 added a commit to Jont828/dynamo that referenced this pull request Nov 11, 2026
…hanges

Adjustments for upstream changes that landed after this branch's old
merge base and that the rebase does not catch as conflicts:

- Qwen3-ASR example (ai-dynamo#15671) added deploy/agg_asr.yaml,
  deploy/agg_asr_realtime.yaml, and launch/agg_asr.sh under
  examples/backends/vllm, and renamed launch/agg_realtime_transcription.sh
  to agg_asr_realtime.sh. Embed the three new sources on the Audio and
  Realtime Serving page, with the audio-transfer and image notes upstream
  added to the vLLM deploy README, follow the rename (also the change
  upstream made in the removed vLLM CLI template), and update the card
  keywords on the overview and Workloads pages.
- The use-case refactor (ai-dynamo#16607) moved diffusion/workflows/text-to-audio.md
  to speech/text-to-speech.md. Point the Audio Generation links, and their
  text, at the new page.
- ai-dynamo#16607 moved the GPU sharing walkthroughs from use-cases/gpu-sharing/
  into examples/gpu-sharing/docs/ and replaced gpu-sharing-results.mdx
  with overview.mdx. Retarget the GPU Sharing example page, linking the
  walkthroughs on GitHub, and describe the README as this branch now
  shapes it: a file list that links each configuration's guide.
- ai-dynamo#16607 deleted use-cases/multimodal-serving/voice.md and moved its
  content to speech/voice-pipelines.md and speech/speech-to-text.md. Carry
  over this branch's change to voice.md: point the Nemotron deployment and
  external-orchestration links at the migrated Nemotron Speech Pipeline
  page instead of README anchors this branch removes.
- ai-dynamo#18210 added a concurrency and result-delivery tuning section to the
  batch-gateway README, whose content this branch moved to
  offline-batch-inference.md. Port the section there, with Title Case
  headings to match the page and the working directory stated as
  elsewhere on the page.

Signed-off-by: Jonathan Tong <jt572@cornell.edu>
Automated-by: pr-shepherd
Jont828 added a commit to Jont828/dynamo that referenced this pull request Nov 15, 2026
…hanges

Adjustments for upstream changes that landed after this branch's old
merge base and that the rebase does not catch as conflicts:

- Qwen3-ASR example (ai-dynamo#15671) added deploy/agg_asr.yaml,
  deploy/agg_asr_realtime.yaml, and launch/agg_asr.sh under
  examples/backends/vllm, and renamed launch/agg_realtime_transcription.sh
  to agg_asr_realtime.sh. Embed the three new sources on the Audio and
  Realtime Serving page, with the audio-transfer and image notes upstream
  added to the vLLM deploy README, follow the rename (also the change
  upstream made in the removed vLLM CLI template), and update the card
  keywords on the overview and Workloads pages.
- The use-case refactor (ai-dynamo#16607) moved diffusion/workflows/text-to-audio.md
  to speech/text-to-speech.md. Point the Audio Generation links, and their
  text, at the new page.
- ai-dynamo#16607 moved the GPU sharing walkthroughs from use-cases/gpu-sharing/
  into examples/gpu-sharing/docs/ and replaced gpu-sharing-results.mdx
  with overview.mdx. Retarget the GPU Sharing example page, linking the
  walkthroughs on GitHub, and describe the README as this branch now
  shapes it: a file list that links each configuration's guide.
- ai-dynamo#16607 deleted use-cases/multimodal-serving/voice.md and moved its
  content to speech/voice-pipelines.md and speech/speech-to-text.md. Carry
  over this branch's change to voice.md: point the Nemotron deployment and
  external-orchestration links at the migrated Nemotron Speech Pipeline
  page instead of README anchors this branch removes.
- ai-dynamo#18210 added a concurrency and result-delivery tuning section to the
  batch-gateway README, whose content this branch moved to
  offline-batch-inference.md. Port the section there, with Title Case
  headings to match the page and the working directory stated as
  elsewhere on the page.

Signed-off-by: Jonathan Tong <jt572@cornell.edu>
Automated-by: pr-shepherd
Jont828 added a commit to Jont828/dynamo that referenced this pull request Nov 17, 2026
…hanges

Adjustments for upstream changes that landed after this branch's old
merge base and that the rebase does not catch as conflicts:

- Qwen3-ASR example (ai-dynamo#15671) added deploy/agg_asr.yaml,
  deploy/agg_asr_realtime.yaml, and launch/agg_asr.sh under
  examples/backends/vllm, and renamed launch/agg_realtime_transcription.sh
  to agg_asr_realtime.sh. Embed the three new sources on the Audio and
  Realtime Serving page, with the audio-transfer and image notes upstream
  added to the vLLM deploy README, follow the rename (also the change
  upstream made in the removed vLLM CLI template), and update the card
  keywords on the overview and Workloads pages.
- The use-case refactor (ai-dynamo#16607) moved diffusion/workflows/text-to-audio.md
  to speech/text-to-speech.md. Point the Audio Generation links, and their
  text, at the new page.
- ai-dynamo#16607 moved the GPU sharing walkthroughs from use-cases/gpu-sharing/
  into examples/gpu-sharing/docs/ and replaced gpu-sharing-results.mdx
  with overview.mdx. Retarget the GPU Sharing example page, linking the
  walkthroughs on GitHub, and describe the README as this branch now
  shapes it: a file list that links each configuration's guide.
- ai-dynamo#16607 deleted use-cases/multimodal-serving/voice.md and moved its
  content to speech/voice-pipelines.md and speech/speech-to-text.md. Carry
  over this branch's change to voice.md: point the Nemotron deployment and
  external-orchestration links at the migrated Nemotron Speech Pipeline
  page instead of README anchors this branch removes.
- ai-dynamo#18210 added a concurrency and result-delivery tuning section to the
  batch-gateway README, whose content this branch moved to
  offline-batch-inference.md. Port the section there, with Title Case
  headings to match the page and the working directory stated as
  elsewhere on the page.

Signed-off-by: Jonathan Tong <jt572@cornell.edu>
Automated-by: pr-shepherd

This branch was previously deployed

1 inactive deployment
external_collaborator — 7f36999e Deployed Nov 5, 2026 by akshatha-k via ok-to-test #46930
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

backend::sglang Relates to the sglang backend backend::vllm Relates to the vllm backend docs documentation Improvements or additions to documentation frontend `python -m dynamo.frontend` and `dynamo-run in=http|text|grpc` size/XXL xpu

Projects

None yet

Development

Successfully merging this pull request may close these issues.

8 participants