Add riscv64 build, make Linux wheel build matrix more explicit by threexc · Pull Request #288 · guidance-ai/llguidance

threexc · 2026-02-19T13:07:41Z

maturin supports riscv64 cross build, but the arch string and the target toolchain for rustc don't exactly match up (this is also the case for other architectures like ppc64le and x86). To make the riscv64 addition consistent with the others, change the platform list so that arch and target are distinct fields.

Note that this is being done on behalf of the RISE Project to improve Python ecosystem support on riscv64 platforms.

hudson-ai · 2026-02-20T01:53:39Z

Hey @threexc thank you for the contribution! General approach looks good -- would you mind merging or rebasing on the new changes in main?

threexc · 2026-02-20T14:33:38Z

Hey @threexc thank you for the contribution! General approach looks good -- would you mind merging or rebasing on the new changes in main?

Should be OK now. Please let me know if there are any other issues.

hudson-ai · 2026-02-20T18:23:08Z

Ran the workflow on my fork and hit some issues.

error: unable to find or provide libc for target 'riscv64-linux.4.19...6.5.7-gnu.2.17'
info: zig can provide libc for related target riscv64-linux-gnu
info: zig can provide libc for related target riscv64-linux-musl

I was thinking that we can just skip --zig for riscv64, e.g. by adding a boolean field to each matrix entry:

platform:
  - runner: ubuntu-latest
    target: x86_64-unknown-linux-gnu
    arch: x86_64
    zig: true
  - runner: ubuntu-latest
    target: riscv64gc-unknown-linux-gnu
    arch: riscv64
    zig: false

and updating the args line:

args: --release --out dist ${{ matrix.python-version != '3.14t' && matrix.platform.zig && '--zig' || '' }}

I tried this out, but I ran into another issue

💥 maturin failed
  Caused by: Error ensuring manylinux_2_17 compliance
  Caused by: Your library is not manylinux_2_17 (aka manylinux2014) compliant because it has unsupported architecture: riscv64

Might have to make a different choice than manylinux: auto for maturin?

threexc · 2026-02-22T13:55:54Z

Ran the workflow on my fork and hit some issues.

error: unable to find or provide libc for target 'riscv64-linux.4.19...6.5.7-gnu.2.17'
info: zig can provide libc for related target riscv64-linux-gnu
info: zig can provide libc for related target riscv64-linux-musl

I was thinking that we can just skip --zig for riscv64, e.g. by adding a boolean field to each matrix entry:

platform:
  - runner: ubuntu-latest
    target: x86_64-unknown-linux-gnu
    arch: x86_64
    zig: true
  - runner: ubuntu-latest
    target: riscv64gc-unknown-linux-gnu
    arch: riscv64
    zig: false

and updating the args line:

args: --release --out dist ${{ matrix.python-version != '3.14t' && matrix.platform.zig && '--zig' || '' }}

I tried this out, but I ran into another issue

💥 maturin failed
  Caused by: Error ensuring manylinux_2_17 compliance
  Caused by: Your library is not manylinux_2_17 (aka manylinux2014) compliant because it has unsupported architecture: riscv64

Might have to make a different choice than manylinux: auto for maturin?

Thanks for catching that. I've modified the patch to set manylinux: 2_39 for riscv64.

Make the Linux matrix more explicit by distinguishing between the 'target' and the 'arch', which are not always the same. This pattern is better suited to architectures where they don't match. Also explicitly set a boolean flag for 'zig', since not all architectures may support it. Signed-off-by: Trevor Gamblin <tgamblin@baylibre.com>

Skip zig to avoid this error: |error: unable to find or provide libc for target 'riscv64-linux.4.19...6.5.7-gnu.2.17' |info: zig can provide libc for related target riscv64-linux-gnu |info: zig can provide libc for related target riscv64-linux-musl Signed-off-by: Trevor Gamblin <tgamblin@baylibre.com>

threexc · 2026-02-23T13:03:50Z

@hudson-ai I think I misread your reply the first time around. I've fixed things up now. Notably, I've added manylinux: 2_39 since that's the version supporting riscv64. The docs seem unclear about whether this works for all architectures though, so if that's the case I'll be explicit about it for each architecture.

Testing here: threexc#2

hudson-ai · 2026-02-23T17:37:23Z

@threexc it's still not working due to some linker issues. Please see the workflow run here:
https://github.com/hudson-ai/llguidance/actions/runs/22317382312/job/64566147286

hudson-ai · 2026-02-23T17:40:38Z

Annoyingly, it's not trivial to run the right workflow from a fork; you may have to add a workflow-dispatch trigger (please remove before we actually merge...) and possibly even run it from the command-line, like gh workflow run wheels.yml --ref tgamblin/riscv64-test -R threexc/llguidance

hudson-ai · 2026-02-23T18:27:03Z

@threexc I got it working with the following configuration.

Note the before-script that explicitly installs and sets the linker. I also made the matrix a lot more explicit.

  linux:
    runs-on: ${{ matrix.platform.runner }}
    needs: [sdist]
    strategy:
      matrix:
        platform:
          - runner: ubuntu-latest
            target: x86_64-unknown-linux-gnu
            arch: x86_64
            zig: true
            manylinux: auto
          - runner: ubuntu-latest
            target: i686-unknown-linux-gnu
            arch: x86
            zig: true
            manylinux: auto
          - runner: ubuntu-latest
            target: aarch64-unknown-linux-gnu
            arch: aarch64
            zig: true
            manylinux: auto
          - runner: ubuntu-latest
            target: riscv64gc-unknown-linux-gnu
            arch: riscv64
            zig: false
            manylinux: 2_39
            before-script: 'sudo apt-get install -y gcc-riscv64-linux-gnu && mkdir -p ~/.cargo && printf "[target.riscv64gc-unknown-linux-gnu]\nlinker = \"riscv64-linux-gnu-gcc\"\n" >> ~/.cargo/config.toml'
        python:
          - version: '3.12'
            zig: true
          - version: '3.14t'
            zig: false
        exclude:
          - platform:
              arch: riscv64
            python:
              version: '3.14t'
    steps:
      - uses: actions/checkout@v6
      - uses: actions/setup-python@v6
        with:
          python-version: ${{ matrix.python.version }}
      - name: Build wheels
        uses: PyO3/maturin-action@v1
        with:
          target: ${{ matrix.platform.target }}
          args: --release --out dist ${{ matrix.python.zig && matrix.platform.zig && '--zig' || '' }}
          sccache: 'true'
          manylinux: ${{ matrix.platform.manylinux }}
          before-script-linux: ${{ matrix.platform.before-script || '' }}
      - name: Upload wheels
        uses: actions/upload-artifact@v6
        with:
          name: wheels-linux-${{ matrix.platform.arch }}-${{ matrix.python.version }}
          path: dist

hudson-ai · 2026-02-23T18:30:10Z

Note that I excluded the (3.14t, riscv64) pair, which failed seemingly due to some PyO3 weirdness: https://github.com/hudson-ai/llguidance/actions/runs/22318409028/job/64569802785

@ngoldbaum maybe you know what's going on here and can chime in?

riedgar-ms · 2026-02-23T18:34:43Z

My concern with this is that we don't actually have RISC-V runners to validate on. If we merge, we should make it very clear that this arch is provided as-is.

ngoldbaum · 2026-02-23T19:04:00Z

> 📦 Wheel is eligible for a higher priority tag. You requested manylinux_2_39 but this wheel is eligible for manylinux_2_34
📦 Built wheel for abi3 Python ≥ 3.9 to dist/llguidance-1.5.1-cp39-abi3-manylinux_2_39_riscv64.whl
⚠️ Warning: CPython 3.14t at /opt/hostedtoolcache/Python/3.14.3/x64-freethreaded/bin/python3.14 does not yet support abi3 so the build artifacts will be version-specific.

Looks like a maturin bug, you shouldn't be getting an abi3 wheel. I opened PyO3/maturin#3034.

hudson-ai · 2026-02-23T19:06:05Z

Looks like a maturin bug, you shouldn't be getting an abi3 wheel. I opened PyO3/maturin#3034.

Got it. Thanks a bunch!

threexc · 2026-02-23T19:46:44Z

@threexc I got it working with the following configuration.

Note the before-script that explicitly installs and sets the linker. I also made the matrix a lot more explicit.

  linux:
    runs-on: ${{ matrix.platform.runner }}
    needs: [sdist]
    strategy:
      matrix:
        platform:
          - runner: ubuntu-latest
            target: x86_64-unknown-linux-gnu
            arch: x86_64
            zig: true
            manylinux: auto
          - runner: ubuntu-latest
            target: i686-unknown-linux-gnu
            arch: x86
            zig: true
            manylinux: auto
          - runner: ubuntu-latest
            target: aarch64-unknown-linux-gnu
            arch: aarch64
            zig: true
            manylinux: auto
          - runner: ubuntu-latest
            target: riscv64gc-unknown-linux-gnu
            arch: riscv64
            zig: false
            manylinux: 2_39
            before-script: 'sudo apt-get install -y gcc-riscv64-linux-gnu && mkdir -p ~/.cargo && printf "[target.riscv64gc-unknown-linux-gnu]\nlinker = \"riscv64-linux-gnu-gcc\"\n" >> ~/.cargo/config.toml'
        python:
          - version: '3.12'
            zig: true
          - version: '3.14t'
            zig: false
        exclude:
          - platform:
              arch: riscv64
            python:
              version: '3.14t'
    steps:
      - uses: actions/checkout@v6
      - uses: actions/setup-python@v6
        with:
          python-version: ${{ matrix.python.version }}
      - name: Build wheels
        uses: PyO3/maturin-action@v1
        with:
          target: ${{ matrix.platform.target }}
          args: --release --out dist ${{ matrix.python.zig && matrix.platform.zig && '--zig' || '' }}
          sccache: 'true'
          manylinux: ${{ matrix.platform.manylinux }}
          before-script-linux: ${{ matrix.platform.before-script || '' }}
      - name: Upload wheels
        uses: actions/upload-artifact@v6
        with:
          name: wheels-linux-${{ matrix.platform.arch }}-${{ matrix.python.version }}
          path: dist

Thank you! I hadn't gotten around to trying your suggestions yet. Do you want to make an extra commit to fix and squash the changes, or do you want me to submit that?

hudson-ai · 2026-02-23T19:52:39Z

@threexc I'm happy to push a commit and squash. Sorry if I stepped on your toes here. Just eager to merge in before doing a release :)

…exclude riscv64 x python3.14

hudson-ai · 2026-02-23T20:04:03Z

Workflow is green: https://github.com/hudson-ai/llguidance/actions/runs/22322576909

@riedgar-ms you ok with me merging if I note the untested riscv support in the changelog upon the next release?

riedgar-ms

OK with the 'untested' note

threexc · 2026-02-23T21:20:20Z

@hudson-ai no problem! I'm just happy to see RISC-V support :)

Thank you everyone.

threexc force-pushed the tgamblin/riscv64 branch from 3d21af0 to 124c4eb Compare February 20, 2026 14:32

threexc force-pushed the tgamblin/riscv64 branch from 124c4eb to be4ce10 Compare February 22, 2026 13:52

threexc added 2 commits February 23, 2026 08:01

threexc force-pushed the tgamblin/riscv64 branch from be4ce10 to 3bc6837 Compare February 23, 2026 13:02

hudson-ai reviewed Feb 23, 2026

View reviewed changes

Comment thread .github/workflows/wheels.yml

ngoldbaum mentioned this pull request Feb 23, 2026

riscv64 free-threaded Python incorrectly builds abi3 wheel PyO3/maturin#3034

Closed

2 tasks

install riscv64 linker; make linux build matrix a bit more explicit; …

6763f17

…exclude riscv64 x python3.14

riedgar-ms approved these changes Feb 23, 2026

View reviewed changes

hudson-ai merged commit 5b9b77b into guidance-ai:main Feb 23, 2026
5 checks passed

threexc mentioned this pull request Jun 23, 2026

llguidance riscv64 support riseproject-dev/python-wheels#32

Closed

Uh oh!

Conversation

threexc commented Feb 19, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

hudson-ai commented Feb 20, 2026

Uh oh!

threexc commented Feb 20, 2026

Uh oh!

hudson-ai commented Feb 20, 2026

Uh oh!

threexc commented Feb 22, 2026

Uh oh!

threexc commented Feb 23, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

Uh oh!

hudson-ai commented Feb 23, 2026

Uh oh!

hudson-ai commented Feb 23, 2026

Uh oh!

hudson-ai commented Feb 23, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

hudson-ai commented Feb 23, 2026

Uh oh!

riedgar-ms commented Feb 23, 2026

Uh oh!

ngoldbaum commented Feb 23, 2026

Uh oh!

hudson-ai commented Feb 23, 2026

Uh oh!

threexc commented Feb 23, 2026

Uh oh!

hudson-ai commented Feb 23, 2026

Uh oh!

hudson-ai commented Feb 23, 2026

Uh oh!

riedgar-ms left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

threexc commented Feb 23, 2026

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

4 participants

threexc commented Feb 19, 2026 •

edited

Loading

threexc commented Feb 23, 2026 •

edited

Loading

hudson-ai commented Feb 23, 2026 •

edited

Loading