Skip to content

Tritonserver from branch main demand libonnxruntime.so.1.14.1 but build.py gives libonnxruntime.so.1.18.1 #7487

@wolfgangsmdt

Description

@wolfgangsmdt

Description
compilling triton from branch main with onnxruntime backend demand libonnxruntime.so.1.14.1 while the one compiled from build.py is libonnxruntime.so.1.18.1

Triton Information
from branch main 24.07dev

To Reproduce

git clone https://github.com/triton-inference-server/server.git
cd server
./build.py -v --target-machine aarch64 --enable-logging --enable-stats --enable-metrics --enable-cpu-metrics --enable-tracing --endpoint grpc --backend onnxruntime

RESULTS
After compilling triton with onnxruntime backend it succeed. However, the executable ./build/bin/tritonserver is looking for libonnxruntime.so.1.14.1 while the one compiled is ./build/backends/onnxruntime/libonnxruntime.so.1.18.1

I tried to compile the version 1.14.1 from the onnxruntime backend repo here but it failed with the error that --allow_running_as_root option is not recognized. which is true have a look to onnxruntime 1.18.1 build.py VS onnxruntime 1.14.1 build.py

What to do next? How do I compile Tritonserver with onnxruntime backend?

Thanks

Metadata

Metadata

Assignees

No one assigned

    Labels

    module: platformsIssues related to platforms, hardware, and support matrix

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions