Skip to content

[BugFix] fix TPDP mix parallel infer#4583

Merged
Jiang-Jia-Jun merged 2 commits intoPaddlePaddle:developfrom
lizhenyun01:tpdp_mix
Oct 28, 2025
Merged

[BugFix] fix TPDP mix parallel infer#4583
Jiang-Jia-Jun merged 2 commits intoPaddlePaddle:developfrom
lizhenyun01:tpdp_mix

Conversation

@lizhenyun01
Copy link
Copy Markdown
Collaborator

@lizhenyun01 lizhenyun01 commented Oct 24, 2025

Motivation

  1. 修复TPDP混合并行下local_data_parallel_id计算错误的问题
  2. 支持load_weight v0下混合并行只load部分权重,避免显存爆炸

@paddle-bot
Copy link
Copy Markdown

paddle-bot bot commented Oct 24, 2025

Thanks for your contribution!

Copy link
Copy Markdown
Collaborator

@carryyu carryyu left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@Jiang-Jia-Jun Jiang-Jia-Jun merged commit 4d2f478 into PaddlePaddle:develop Oct 28, 2025
23 of 28 checks passed
@lizhenyun01 lizhenyun01 deleted the tpdp_mix branch December 25, 2025 08:51
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants