Skip to content

[BugFix] fix total_block_num init error in worker_process and test_async_llm not throw error#4687

Merged
Jiang-Jia-Jun merged 1 commit intoPaddlePaddle:developfrom
xyxinyang:fix-asyncllm
Oct 30, 2025
Merged

[BugFix] fix total_block_num init error in worker_process and test_async_llm not throw error#4687
Jiang-Jia-Jun merged 1 commit intoPaddlePaddle:developfrom
xyxinyang:fix-asyncllm

Conversation

@xyxinyang
Copy link
Copy Markdown
Collaborator

Motivation

fix num-gpu-blocks-override is not passed correctly to worker_process

fix test_async_llm can't throw error when failed

Modifications

Usage or Command

Accuracy Tests

Checklist

  • Add at least a tag in the PR title.
    • Tag list: [[FDConfig],[APIServer],[Engine], [Scheduler], [PD Disaggregation], [Executor], [Graph Optimization], [Speculative Decoding], [RL], [Models], [Quantization], [Loader], [OP], [KVCache], [DataProcessor], [BugFix], [Docs], [CI], [Optimization], [Feature], [Benchmark], [Others], [XPU], [HPU], [GCU], [DCU], [Iluvatar], [Metax]]
    • You can add new tags based on the PR content, but the semantics must be clear.
  • Format your code, run pre-commit before commit.
  • Add unit tests. Please write the reason in this PR if no unit tests.
  • Provide accuracy results.
  • If the current PR is submitting to the release branch, make sure the PR has been submitted to the develop branch, then cherry-pick it to the release branch with the [Cherry-Pick] PR tag.

@paddle-bot
Copy link
Copy Markdown

paddle-bot bot commented Oct 30, 2025

Thanks for your contribution!

@paddle-bot paddle-bot bot added the contributor External developers label Oct 30, 2025
@Jiang-Jia-Jun Jiang-Jia-Jun merged commit 35286ce into PaddlePaddle:develop Oct 30, 2025
14 of 15 checks passed
@xyxinyang xyxinyang deleted the fix-asyncllm branch October 30, 2025 12:12
chang-wenbin pushed a commit to chang-wenbin/FastDeploy that referenced this pull request Mar 2, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

contributor External developers

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants