Skip to content

Factor out eager val from eval_llama_lib #3756

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
wants to merge 5 commits into from

Conversation

cccclai
Copy link
Contributor

@cccclai cccclai commented May 28, 2024

Stack from ghstack (oldest at bottom):

Would like to re-use EagerEvalWrapper and eval function for quantization calibration.

Differential Revision: D57881028

Would like to re-use EagerEvalWrapper and eval function for quantization calibration.

Differential Revision: [D57881028](https://our.internmc.facebook.com/intern/diff/D57881028/)

[ghstack-poisoned]
Copy link

pytorch-bot bot commented May 28, 2024

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/executorch/3756

Note: Links to docs will display an error until the docs builds have been completed.

✅ No Failures

As of commit 3483891 with merge base 757a6ad (image):
💚 Looks good so far! There are no failures yet. 💚

This comment was automatically generated by Dr. CI and updates every 15 minutes.

@facebook-github-bot facebook-github-bot added the CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. label May 28, 2024
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D57881028

cccclai added a commit that referenced this pull request May 28, 2024
Would like to re-use EagerEvalWrapper and eval function for quantization calibration.

Differential Revision: [D57881028](https://our.internmc.facebook.com/intern/diff/D57881028/)

ghstack-source-id: 227994056
Pull Request resolved: #3756
Would like to re-use EagerEvalWrapper and eval function for quantization calibration.

Differential Revision: [D57881028](https://our.internmc.facebook.com/intern/diff/D57881028/)

[ghstack-poisoned]
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D57881028

cccclai added a commit that referenced this pull request May 28, 2024
Pull Request resolved: #3756

Would like to re-use EagerEvalWrapper and eval function for quantization calibration.
ghstack-source-id: 227999069
@exported-using-ghexport

Differential Revision: [D57881028](https://our.internmc.facebook.com/intern/diff/D57881028/)
Would like to re-use EagerEvalWrapper and eval function for quantization calibration.

Differential Revision: [D57881028](https://our.internmc.facebook.com/intern/diff/D57881028/)

[ghstack-poisoned]
@cccclai cccclai requested a review from Jack-Khuu May 28, 2024 21:49
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D57881028

@cccclai cccclai requested a review from lucylq May 28, 2024 21:49
cccclai added a commit that referenced this pull request May 28, 2024
Pull Request resolved: #3756

Would like to re-use EagerEvalWrapper and eval function for quantization calibration.
ghstack-source-id: 228001053
@exported-using-ghexport

Differential Revision: [D57881028](https://our.internmc.facebook.com/intern/diff/D57881028/)
@cccclai cccclai requested a review from jerryzh168 May 28, 2024 21:52
Would like to re-use EagerEvalWrapper and eval function for quantization calibration.

Differential Revision: [D57881028](https://our.internmc.facebook.com/intern/diff/D57881028/)

[ghstack-poisoned]
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D57881028

Copy link
Contributor

@Jack-Khuu Jack-Khuu left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for the refactor, makes things easier to reference


try:
from ...portable.utils import export_to_edge, save_pte_program
except ImportError:
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

let's put this as a task to fix separately. I've seem this issue in other parts of the repo too

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yeah makes sense. Let me update

Would like to re-use EagerEvalWrapper and eval function for quantization calibration.

Differential Revision: [D57881028](https://our.internmc.facebook.com/intern/diff/D57881028/)

[ghstack-poisoned]
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D57881028

cccclai added a commit that referenced this pull request May 29, 2024
Pull Request resolved: #3756

Would like to re-use EagerEvalWrapper and eval function for quantization calibration.
ghstack-source-id: 228123244
@exported-using-ghexport

Differential Revision: [D57881028](https://our.internmc.facebook.com/intern/diff/D57881028/)
@facebook-github-bot
Copy link
Contributor

This pull request has been merged in fbbba34.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. fb-exported Merged
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants