Skip to content

[BugFix] fix offline stream output when set enable_thinking param#4603

Merged
Jiang-Jia-Jun merged 1 commit intoPaddlePaddle:developfrom
xyxinyang:fix-offline
Oct 27, 2025
Merged

[BugFix] fix offline stream output when set enable_thinking param#4603
Jiang-Jia-Jun merged 1 commit intoPaddlePaddle:developfrom
xyxinyang:fix-offline

Conversation

@xyxinyang
Copy link
Copy Markdown
Collaborator

@xyxinyang xyxinyang commented Oct 27, 2025

Motivation

修复了离线推理流式输出时,设置enable_thinking 参数时出错的 bug

Modifications

Usage or Command

Accuracy Tests

Checklist

  • Add at least a tag in the PR title.
    • Tag list: [[FDConfig],[APIServer],[Engine], [Scheduler], [PD Disaggregation], [Executor], [Graph Optimization], [Speculative Decoding], [RL], [Models], [Quantization], [Loader], [OP], [KVCache], [DataProcessor], [BugFix], [Docs], [CI], [Optimization], [Feature], [Benchmark], [Others], [XPU], [HPU], [GCU], [DCU], [Iluvatar], [Metax]]
    • You can add new tags based on the PR content, but the semantics must be clear.
  • Format your code, run pre-commit before commit.
  • Add unit tests. Please write the reason in this PR if no unit tests.
  • Provide accuracy results.
  • If the current PR is submitting to the release branch, make sure the PR has been submitted to the develop branch, then cherry-pick it to the release branch with the [Cherry-Pick] PR tag.

@paddle-bot
Copy link
Copy Markdown

paddle-bot bot commented Oct 27, 2025

Thanks for your contribution!

@paddle-bot paddle-bot bot added the contributor External developers label Oct 27, 2025
@xyxinyang xyxinyang changed the title [BugFix] fix offline stream output when enable_thinking is true [BugFix] fix offline stream output when set enable_thinking param Oct 27, 2025
@Jiang-Jia-Jun Jiang-Jia-Jun merged commit 6dcf5a3 into PaddlePaddle:develop Oct 27, 2025
15 of 16 checks passed
@xyxinyang xyxinyang deleted the fix-offline branch October 30, 2025 12:12
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants