Skip to content

Fix attribute issue with deepspeed tp#3443

Merged
SunMarc merged 1 commit intomainfrom
fix-ds-tp
Mar 13, 2025
Merged

Fix attribute issue with deepspeed tp#3443
SunMarc merged 1 commit intomainfrom
fix-ds-tp

Conversation

@SunMarc
Copy link
Member

@SunMarc SunMarc commented Mar 13, 2025

What does this PR do ?

This PR fixes #3390 (comment). deepspeed_config don't necessarily have the tensor_parallel key

@HuggingFaceDocBuilderDev

The docs for this PR live here. All of your documentation changes will be reflected on that endpoint. The docs are available until 30 days after the last update.

@SunMarc SunMarc merged commit a702364 into main Mar 13, 2025
28 checks passed
@SunMarc SunMarc deleted the fix-ds-tp branch March 13, 2025 17:27
@inkcherry
Copy link
Contributor

thanks for the fix!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants