Skip to content

Support exporting QNN models with Python wheels out-of-the-box #9474

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
jathu opened this issue Mar 20, 2025 · 1 comment
Open

Support exporting QNN models with Python wheels out-of-the-box #9474

jathu opened this issue Mar 20, 2025 · 1 comment
Assignees
Labels
module: build/install Issues related to the cmake and buck2 builds, and to installing ExecuTorch partner: qualcomm For backend delegation, kernels, demo, etc. from the 3rd-party partner, Qualcomm
Milestone

Comments

@jathu
Copy link
Contributor

jathu commented Mar 20, 2025

As part of #9019, we recently added CoreML export support "out of the box" for the executorch pip package: #9483. Developers can now export to CoreML backend, by just pip installing executorch — previously this required cloning the ExecuTorch repo, and building everything from source. We anticipate this to encourage ET adopting for CoreML.

We want to provide the same developer experience when exporting models to Android on Qualcomm chips.

Currently, this requires developers to manually download the QNN SDK, clone the ExecuTorch repo, and build everything from source. Similar to CoreML, we should bundle this requirement into ExecuTorch. Given the QNN library is currently only distributed as a zip file, here are some potential next steps:

  • [Preferred] Ideally, Qualcomm should provide the SDK through pip so we can just include that as a dependency. This is what we currently do with CoreML
  • [Preferred] While we wait for Qualcomm, we can temporarily bundle the library into executorch. This will require permission from Qualcomm
  • [Not ideal] At the very least, we should automate downloading the SDK in the build script

cc @larryliu0820 @cccclai @winskuo-quic @shewu-quic @cbilgin @lucylq

@jathu jathu added the module: build/install Issues related to the cmake and buck2 builds, and to installing ExecuTorch label Mar 20, 2025
@cccclai
Copy link
Contributor

cccclai commented Mar 20, 2025

cc: @shewu-quic @shewu-quic @haowhsu-quic @winskuo-quic @DannyYuyang-quic

Currently we require users to download the qnn library and a script to install, we may need to figure out

  1. can the qnn library downloading part of the script
  2. can qnn library be part of the wheel package

@github-project-automation github-project-automation bot moved this to To triage in ExecuTorch DevX Apr 7, 2025
@jathu jathu added this to the 0.7.0 milestone Apr 7, 2025
@jathu jathu moved this from To triage to Ready in ExecuTorch DevX Apr 7, 2025
@jathu jathu moved this from Ready to Backlog in ExecuTorch DevX Apr 7, 2025
@cccclai cccclai added the partner: qualcomm For backend delegation, kernels, demo, etc. from the 3rd-party partner, Qualcomm label Apr 21, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
module: build/install Issues related to the cmake and buck2 builds, and to installing ExecuTorch partner: qualcomm For backend delegation, kernels, demo, etc. from the 3rd-party partner, Qualcomm
Projects
Status: Backlog
Development

No branches or pull requests

2 participants