Skip to content

Make minor updates to LLM guide setup instructions #2959

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 1 commit into from
Apr 10, 2024
Merged

Make minor updates to LLM guide setup instructions #2959

Changes from all commits
Commits
Show all changes
1 commit
Select commit
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
30 changes: 24 additions & 6 deletions docs/source/llm/getting-started.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -15,8 +15,9 @@
## Prerequisites

To follow this guide, you'll need to clone the ExecuTorch repository and install dependencies.
ExecuTorch requires Python 3.10, as well as This example uses
conda to manage the Python environment.
ExecuTorch recommends Python 3.10 and the use of Conda to manage your environment. Conda is not
required, though be aware that you may need to replace the use of python/pip with python3/pip3
depending on your environment.

::::{tab-set}
:::{tab-item} conda
Expand Down Expand Up @@ -57,7 +58,7 @@ eval "$(pyenv virtualenv-init -)"
mkdir et-nanogpt
cd et-nanogpt

pyenv install 3.10
pyenv install -s 3.10
pyenv virtualenv 3.10 executorch
pyenv activate executorch

Expand All @@ -68,8 +69,8 @@ cd third-party/executorch
git submodule update --init

# Install requirements.
pip3 install cmake zstd
./install_requirements.sh
pip install cmake zstd
PYTHON_EXECUTABLE=python ./install_requirements.sh

cd ../..
```
Expand Down Expand Up @@ -328,7 +329,6 @@ set(CMAKE_CXX_STANDARD_REQUIRED True)
option(EXECUTORCH_BUILD_EXTENSION_DATA_LOADER "" ON)
option(EXECUTORCH_BUILD_EXTENSION_MODULE "" ON)
option(EXECUTORCH_BUILD_OPTIMIZED "" ON)
option(EXECUTORCH_BUILD_XNNPACK "" ON)

# Include the executorch subdirectory.
add_subdirectory(
Expand Down Expand Up @@ -409,6 +409,24 @@ et_program = edge_manager.to_executorch()

```

Additionally, update CMakeLists.txt to build and link the XNNPACK backend.

```
option(EXECUTORCH_BUILD_XNNPACK "" ON)

# ...

add_executable(nanogpt_runner main.cpp)
target_link_libraries(
nanogpt_runner
PRIVATE
executorch
extension_module_static # Provides the Module class
optimized_native_cpu_ops_lib # Provides baseline cross-platform kernels
xnnpack_backend) # Provides the XNNPACK CPU acceleration backend

```

For more information, see the ExecuTorch guides for the [XNNPACK Backend](https://pytorch.org/executorch/stable/tutorial-xnnpack-delegate-lowering.html)
and [CoreML Backend](https://pytorch.org/executorch/stable/build-run-coreml.html).

Expand Down
Loading