Skip to content

Update Hugging Face version #6489

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 1 commit into from
Nov 15, 2024
Merged

Update Hugging Face version #6489

merged 1 commit into from
Nov 15, 2024

Conversation

guangy10
Copy link
Contributor

@guangy10 guangy10 commented Oct 24, 2024

Bump version to v4.46.0 where more transformers models are compatible with ExecuTorch out-of-the-box.
Consolidate to use a single version of transformers in anywhere in the codebase, e.g. examples/, .workflow/

However, we are hardcode lm_eval to a very old version 0.4.2 which is not compatible with transformers >= 4.45 (actually incompatible with tokenizers >= 0.20). It must be upgraded, but not in this PR. Since the eval is using the tinyllama in the CI, the version of transformers doesn't matter. The workaround is to force reinstall a lower version in the CI.

Copy link

pytorch-bot bot commented Oct 24, 2024

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/executorch/6489

Note: Links to docs will display an error until the docs builds have been completed.

❗ 1 Active SEVs

There are 1 currently active SEVs. If your PR is affected, please view them below:

❌ 1 New Failure

As of commit 51f64f3 with merge base d7826c8 (image):

NEW FAILURE - The following job has failed:

This comment was automatically generated by Dr. CI and updates every 15 minutes.

@facebook-github-bot facebook-github-bot added the CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. label Oct 24, 2024
@guangy10 guangy10 force-pushed the update_huggingface_version branch 5 times, most recently from 091df31 to 8340c60 Compare October 25, 2024 00:44
@guangy10 guangy10 marked this pull request as ready for review October 25, 2024 00:49
@facebook-github-bot
Copy link
Contributor

@guangy10 has imported this pull request. If you are a Meta employee, you can view this diff on Phabricator.

This was referenced Oct 28, 2024
@guangy10 guangy10 force-pushed the update_huggingface_version branch from 8340c60 to 3161181 Compare October 29, 2024 19:48
@facebook-github-bot
Copy link
Contributor

@guangy10 has imported this pull request. If you are a Meta employee, you can view this diff on Phabricator.

@guangy10
Copy link
Contributor Author

Ok, the circular import issue is still valid. I will resolve it in a separate PR.

@guangy10 guangy10 force-pushed the update_huggingface_version branch 2 times, most recently from db82e06 to 13aafa3 Compare October 30, 2024 00:29
helunwencser added a commit that referenced this pull request Oct 30, 2024
Pull Request resolved: #6533


We have been using a pretty old `lm_eval` version. This is blocking us from upgrading other libraries like `transformers` and blocking some others work. For example, #6489.

In newer versions `lm_eval`, `pretrainedModel` becomes a required parameter. In 0.4.2, it defaults to `gpt2` if not provided. This PR upgrades our `lm_eval` version to the latest version 0.4.5 and set `pretrainedModel` to its original default value `gpt2`.

Differential Revision: [D65079913](https://our.internmc.facebook.com/intern/diff/D65079913/)
ghstack-source-id: 250754584

Co-authored-by: Lunwen He <[email protected]>
@guangy10 guangy10 force-pushed the update_huggingface_version branch from 13aafa3 to 69b00ed Compare November 1, 2024 00:39
@guangy10 guangy10 force-pushed the update_huggingface_version branch from 69b00ed to 51f64f3 Compare November 14, 2024 23:15
@facebook-github-bot
Copy link
Contributor

@guangy10 has imported this pull request. If you are a Meta employee, you can view this diff on Phabricator.

@guangy10
Copy link
Contributor Author

Seems to be a false alarm. Running lintrunner -a and no change is suggested.

@guangy10 guangy10 merged commit a4e2414 into main Nov 15, 2024
40 of 41 checks passed
@guangy10 guangy10 deleted the update_huggingface_version branch November 15, 2024 00:27
@haowhsu-quic haowhsu-quic mentioned this pull request Nov 15, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants