Repository navigation
Quantization cleanpup #49548
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Merged
+420
−1,166
Merged
Quantization cleanpup #49548
Changes from 19 commits
Commits
Show all changes
32 commits
Select commit
Hold shift + click to select a range
e1275af
first cleanup
ArthurZucker 82d6600
more cleanup
ArthurZucker 55a30d4
update
ArthurZucker 09c4a31
sub config fixes
ArthurZucker b0f1a47
more simplification
ArthurZucker d59c65f
debloat more shit, standardize
ArthurZucker a18a8ba
Merge branch 'main' into clean-fp8
ArthurZucker d827652
nits
ArthurZucker b60a646
Merge branch 'clean-fp8' of github.com:huggingface/transformers into …
ArthurZucker 22306f0
fucking bloatland
ArthurZucker 1986e77
Fix PR slow CI suggestion install: non-editable install
ArthurZucker 37a685f
update now that the $ bloat is gone
ArthurZucker 1b89c27
Fix PR slow CI suggestion: install transformers in a venv (system sit…
ArthurZucker 54b9037
metal tests: unanchored weight key
ArthurZucker 6ec139f
nits this time
ArthurZucker 1989c65
up
ArthurZucker 2a78fb4
remove last pieces of dead code
ArthurZucker 52af127
fix failing test
ArthurZucker c656891
fix test
ArthurZucker 783cb72
Merge branch 'main' into clean-fp8
ArthurZucker 84ae499
pr comments
ArthurZucker 3c63249
human coments
ArthurZucker 5b6eab1
Treat scales and etc individually?
ArthurZucker bfb63e2
use a map
ArthurZucker f850c82
replicate explicitely
ArthurZucker 599614f
impl copy
ArthurZucker efe37ea
Merge branch 'main' into clean-fp8
ArthurZucker 1dd7efd
Quantized element size as property, one-line FP8Experts comments, ue8…
ArthurZucker 180a75c
Merge remote-tracking branch 'origin/clean-fp8' into clean-fp8
ArthurZucker 602fd8b
Drop the $ anchor from the bailing_hybrid expert_bias renaming, patte…
ArthurZucker e185b45
Restore the 1 byte quantized element size of FineGrainedFP8
ArthurZucker d6624ae
Quantized element size as a property in every quantizer
ArthurZucker File filter
Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
There are no files selected for viewing
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Oops, something went wrong.
Oops, something went wrong.
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Uh oh!
There was an error while loading. Please reload this page.