Skip to content

Fix fp8 deepspeed config#3492

Merged
SunMarc merged 1 commit intomainfrom
fix-fp8-deepspeed-config
Apr 9, 2025
Merged

Fix fp8 deepspeed config#3492
SunMarc merged 1 commit intomainfrom
fix-fp8-deepspeed-config

Conversation

@SunMarc
Copy link
Member

@SunMarc SunMarc commented Apr 8, 2025

What does this PR do?

Fixes #3489
override_linear_precision is incorrectly set when using accelerate config

@SunMarc SunMarc requested a review from S1ro1 April 8, 2025 12:06
@HuggingFaceDocBuilderDev

The docs for this PR live here. All of your documentation changes will be reflected on that endpoint. The docs are available until 30 days after the last update.

Copy link
Contributor

@S1ro1 S1ro1 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@SunMarc SunMarc merged commit 334d6ab into main Apr 9, 2025
27 of 28 checks passed
@SunMarc SunMarc deleted the fix-fp8-deepspeed-config branch April 9, 2025 12:19
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Accelerate Config produces broken FP8 config for DeepSpeed

3 participants