search

dusty-nv / jetson-containers

Machine Learning Containers for NVIDIA Jetson and JetPack-L4T
MIT License
1.9k stars 416 forks source link

Build ONNX Runtime shared lib #466

Closed michaelgruner closed 3 months ago

michaelgruner commented 3 months ago

Many ORT applications, specially C/C++ ones will link against libonnxruntime.so, which isn't built unless the --build_shared_lib option is passed to the build script.

dusty-nv commented 3 months ago

Thanks @michaelgruner - I also need to update this container for automatically building the wheels for different CUDA/cuDNN/TensorRT versions

dusty-nv commented 3 months ago

@michaelgruner onnxruntime has been updated in commit https://github.com/dusty-nv/jetson-containers/commit/542a0644a1d996ebc9ad6ec2344c026b872cee60 so that it can automatically be rebuilt against different versions of CUDA and to save the pip wheels to the pip server:

http://jetson.webredirect.org/jp6/cu122/onnxruntime-gpu/1.17.0 (that was compiled with --build_shared_lib)

michaelgruner commented 3 months ago

Lightspeed! I'll test in after work.