[Auto Parallel] Add spmd_rule about sharding on the same tensor dim by many mesh dim for reshape #74352
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
|
你的PR提交成功，感谢你对开源项目的贡献! |
ooooo-create
force-pushed
the
co_shard_for_reshape
branch
3 times, most recently
from
512ab0f to
e3a415f
Compare
ooooo-create
force-pushed
the
co_shard_for_reshape
branch
from
e3a415f to
096843e
Compare
ooooo-create
changed the title
Codecov Report❌ Patch coverage is
Additional details and impacted files@@ Coverage Diff @@
## develop #74352 +/- ##
==========================================
Coverage ? 95.15%
==========================================
Files ? 3
Lines ? 165
Branches ? 0
==========================================
Hits ? 157
Misses ? 8
Partials ? 0 ☔ View full report in Codecov by Sentry. 🚀 New features to boost your workflow:
|
ooooo-create
force-pushed
the
co_shard_for_reshape
branch
from
463d98f to
92c910e
Compare
ooooo-create
requested review from
LiYuRio,
ForFishes and
zhiqiu
as code owners
liufengwei0103
approved these changes
Aug 11, 2025
|
/re-run all-failed |
From00
previously approved these changes
Aug 11, 2025
|
/re-run all-failed |
zhiqiu
approved these changes
Aug 12, 2025
maxiaolong001
pushed a commit
to maxiaolong001/Paddle
that referenced
this pull request
Aug 12, 2025
…y many mesh dim for reshape (PaddlePaddle#74352) * Add spmd_rule about sharding on the same tensor dim by many mesh dim for reshape * Fix order * refine code && tests case * fix typos * fix typos * Fix paddle::get usage
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
PR Category
Auto Parallel
PR Types
New features
Description
目前在合并的时候，是把最左边的相邻切分合并到第一个维度进行切分，如果第一个维度不够切，就后续就进行复制，现在的处理是遇到输入切多刀的时候，不够切对应 mesh shape 的乘积，就整个维度的切分不保留，进行复制，就算够切多刀其中的一个维度，{{0},{1,2}} 的时候, 0,1 够切最左边的维度，0,1,2 切不了，现在就会是 {{0}, {}}。
拆分和合并的逻辑相同，都是在多刀在最左边的维度，其余复制，还需要考虑 split 切成的维度够不够切和是否能整除。