[Docs] Add diffusion module design doc#592

Merged

hsliuustc0106 merged 18 commits intovllm-project:mainfrom

SamitHuang:dit_design_doc

Jan 5, 2026

Collaborator

SamitHuang commented Jan 3, 2026

PLEASE FILL IN THE PR DESCRIPTION HERE ENSURING ALL CHECKLIST ITEMS (AT THE BOTTOM) HAVE BEEN CONSIDERED.

Purpose

Add diffusion module design doc

Test Plan

Test Result

Essential Elements of an Effective PR Description Checklist

The purpose of the PR, such as "Fix some issue (link existing issues this PR will resolve)".
The test plan, such as providing test command.
The test results, such as pasting the results comparison before and after, or e2e results
(Optional) The necessary documentation update, such as updating supported_models.md and examples for a new model.
(Optional) Release notes update. If your change is user facing, please update the release notes draft.

BEFORE SUBMITTING, PLEASE READ https://github.com/vllm-project/vllm-omni/blob/main/CONTRIBUTING.md (anything written below this line will be removed by GitHub Actions)

SamitHuang added 7 commits

December 21, 2025 14:38


          init doc

b70da47

Signed-off-by: samithuang <285365963@qq.com>


          update nav

8f59fab

Signed-off-by: samithuang <285365963@qq.com>


          Merge branch 'main' into dit_design_doc

7968f50


          add dit design doc

5a865d9

Signed-off-by: SamitHuang <285365963@qq.com>


          rm redundant files

Signed-off-by: SamitHuang <285365963@qq.com>


          update index

ebe89d2

Signed-off-by: SamitHuang <285365963@qq.com>


          Update doc

a944900

Signed-off-by: Samit <285365963@qq.com>

SamitHuang requested review from ZJY0516 and hsliuustc0106

January 3, 2026 09:46


          update

693d2d1

Added details about the multi-step diffusion loop and CFG support in the documentation.

Signed-off-by: Samit <285365963@qq.com>

ZJY0516 reviewed

View reviewed changes

docs/design/module/dit_module.md Outdated Show resolved Hide resolved

docs/design/module/dit_module.md Show resolved Hide resolved

docs/design/module/dit_module.md Outdated Show resolved Hide resolved

docs/design/module/dit_module.md Show resolved Hide resolved

docs/design/module/dit_module.md Outdated Show resolved Hide resolved

docs/design/module/dit_module.md Outdated Show resolved Hide resolved

hsliuustc0106 requested a review from Isotr0py

January 3, 2026 12:38

Collaborator

hsliuustc0106 commented Jan 3, 2026

@Bounty-hunter PTAL

SamitHuang added 2 commits

January 4, 2026 11:37


          update

4f862ca

Signed-off-by: SamitHuang <285365963@qq.com>


          Merge branch 'dit_design_doc' of github.com:samithuang/vllm-omni into…

82b7158

… dit_design_doc

hsliuustc0106 mentioned this pull request

[Roadmap]: preparing for v0.12.0 release #165

Closed

61 tasks

hsliuustc0106 reviewed

View reviewed changes

docs/design/module/dit_module.md

+. **Automatic Fallback**: Falls back to SDPA if selected backend unavailable
+. **Hardware Detection**: Can select based on device type (NPU, CUDA, etc.)
+              **Backend Availability**:

Collaborator

hsliuustc0106 Jan 4, 2026

no ring attn here?

Collaborator Author

SamitHuang Jan 4, 2026

added. Thanks for reminding

docs/design/module/dit_module.md Show resolved Hide resolved

Isotr0py reviewed

View reviewed changes

docs/design/module/dit_module.md Show resolved Hide resolved

docs/design/module/dit_module.md Outdated Show resolved Hide resolved


          fix doc

9ca01bf

Signed-off-by: SamitHuang <285365963@qq.com>

SamitHuang force-pushed the dit_design_doc branch from e7011cd to 9ca01bf Compare

January 4, 2026 06:58

SamitHuang added 2 commits

January 4, 2026 14:58


          update

fd37890

Signed-off-by: SamitHuang <285365963@qq.com>


          fix format

e73f0c8

Signed-off-by: SamitHuang <285365963@qq.com>

hsliuustc0106 mentioned this pull request

feat: Add multi-modal request batching system #590

Closed

7 tasks

SamitHuang added 4 commits

January 4, 2026 15:43


          Merge branch 'main' into dit_design_doc

d471225


          add parallel attention subsection

29ed98a

Signed-off-by: SamitHuang <285365963@qq.com>


          Merge branch 'dit_design_doc' of github.com:samithuang/vllm-omni into…

db8842b

… dit_design_doc


          add timestep distillation block

1fa9126

Signed-off-by: Samit <285365963@qq.com>

This was referenced Jan 4, 2026

Feat/dit batching #616

Closed

feat: Add dynamic request-level batching for DiT workloads #617

Closed

Bounty-hunter reviewed

View reviewed changes

docs/design/module/dit_module.md Outdated Show resolved Hide resolved

hsliuustc0106 reviewed

View reviewed changes

Collaborator

hsliuustc0106 left a comment

we can update the batching support after #617 merged

docs/design/module/dit_module.md Outdated Show resolved Hide resolved


          Update docs/design/module/dit_module.md

24942f2

Signed-off-by: Hongsheng Liu <liuhongsheng4@huawei.com>

hsliuustc0106 approved these changes

View reviewed changes

Collaborator

hsliuustc0106 left a comment

lgtm

hsliuustc0106 approved these changes

View reviewed changes

hsliuustc0106 merged commit 4cc2827 into vllm-project:main

3 checks passed

DefTruth pushed a commit to xlite-dev/vllm-omni that referenced this pull request


          [Docs] Add diffusion module design doc (vllm-project#592)

ff458a0

Signed-off-by: samithuang <285365963@qq.com>
Signed-off-by: SamitHuang <285365963@qq.com>
Signed-off-by: Samit <285365963@qq.com>
Signed-off-by: Hongsheng Liu <liuhongsheng4@huawei.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
Signed-off-by: DefTruth <qiustudent_r@163.com>

DefTruth pushed a commit to xlite-dev/vllm-omni that referenced this pull request


          [Docs] Add diffusion module design doc (vllm-project#592)

c82c313

Signed-off-by: samithuang <285365963@qq.com>
Signed-off-by: SamitHuang <285365963@qq.com>
Signed-off-by: Samit <285365963@qq.com>
Signed-off-by: Hongsheng Liu <liuhongsheng4@huawei.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>
Signed-off-by: DefTruth <qiustudent_r@163.com>

tzhouam pushed a commit to tzhouam/vllm-omni that referenced this pull request


          [Docs] Add diffusion module design doc (vllm-project#592)

9a9ad65

Signed-off-by: samithuang <285365963@qq.com>
Signed-off-by: SamitHuang <285365963@qq.com>
Signed-off-by: Samit <285365963@qq.com>
Signed-off-by: Hongsheng Liu <liuhongsheng4@huawei.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>

princepride pushed a commit to princepride/vllm-omni that referenced this pull request


          [Docs] Add diffusion module design doc (vllm-project#592)

de194cf

Signed-off-by: samithuang <285365963@qq.com>
Signed-off-by: SamitHuang <285365963@qq.com>
Signed-off-by: Samit <285365963@qq.com>
Signed-off-by: Hongsheng Liu <liuhongsheng4@huawei.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>

sniper35 pushed a commit to sniper35/vllm-omni that referenced this pull request


          [Docs] Add diffusion module design doc (vllm-project#592)

5334c22

Signed-off-by: samithuang <285365963@qq.com>
Signed-off-by: SamitHuang <285365963@qq.com>
Signed-off-by: Samit <285365963@qq.com>
Signed-off-by: Hongsheng Liu <liuhongsheng4@huawei.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>

ZJY0516 pushed a commit to LawJarp-A/vllm-omni that referenced this pull request


          [Docs] Add diffusion module design doc (vllm-project#592)

147562f

Signed-off-by: samithuang <285365963@qq.com>
Signed-off-by: SamitHuang <285365963@qq.com>
Signed-off-by: Samit <285365963@qq.com>
Signed-off-by: Hongsheng Liu <liuhongsheng4@huawei.com>
Co-authored-by: Hongsheng Liu <liuhongsheng4@huawei.com>

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet