ONNX Runtime Python packages now have numpy dependency >=1.21.6, <2.0. Support for numpy 2.0 will be added in a future release.
CUDA 12.x ONNX Runtime GPU packages are now built against cuDNN 9.x (1.18.0 packages previously depended on cuDNN 8.x). CUDA 11.x ONNX Runtime GPU packages continue to depend on CuDNN 8.x.
Windows packages require installation of Microsoft Visual C++ Redistributable Runtime 14.38 or newer.
TensorRT EP:
TensorRT Weightless API integration.
Support for TensorRT hardware compatible engines.
Support for INT64 types in TensorRT constant layer calibration.
Now using latest commit of onnx-tensorrt parser, which includes several issue fixes.
Additional TensorRT support and performance improvements.
Packages:
Publish CUDA 12 Java packages to Azure DevOps feed.
Various packaging pipeline fixes.
This patch release also features various other bug fixes, including a CUDA 12.5 build error fix.
Big thank you to @yf711 for driving this release as the release manager and to all our contributors!
Windows ARM32 support has been dropped at the source code level.
Python version >=3.8 is now required for build.bat/build.sh (previously >=3.7). Note: If you have Python version <3.8, you can bypass the tools and use CMake directly.
The onnxruntime-mobile Android package and onnxruntime-mobile-c/onnxruntime-mobile-objc iOS cocoapods are being deprecated. Please use the onnxruntime-android Android package, and onnxruntime-c/onnxruntime-objc cocoapods, which support ONNX and ORT format models and all operators and data types. Note: If you require a smaller binary size, a custom build is required. See details on creating a custom Android or iOS package on Custom build | onnxruntime.
Build System & Packages
CoreML execution provider now depends on coremltools.
Flatbuffers has been upgraded from 1.12.0 → 23.5.26.
ONNX has been upgraded from 1.15 → 1.16.
EMSDK has been upgraded from 3.1.51 → 3.1.57.
Intel neural_speed library has been upgraded from v0.1.1 → v0.3 with several important bug fixes.
There is a new onnxruntime_CUDA_MINIMAL CMake option for building ONNX Runtime CUDA execution provider without any operations apart from memcpy ops.
Added support for Catalyst for macOS build support.
Added initial support for RISC-V and three new build options for it: --rv64, --riscv_toolchain_root, and --riscv_qemu_path.
Now you can build TensorRT EP with protobuf-lite instead of the full version of protobuf.
Some security-related compile/link flags have been moved from the default setting → new build option: --use_binskim_compliant_compile_flags. Note: All our release binaries are built with this flag, but when building ONNX Runtime from source, this flag is default OFF.
Windows ARM64 build now depends on PyTorch CPUINFO library.
Windows OneCore build now uses “Reverse forwarding” apisets instead of “Direct forwarding”, so onnxruntime.dll in our Nuget packages will depend on kernel32.dll. Note: Windows systems without kernel32.dll need to have reverse forwarders (see API set loader operation - Win32 apps | Microsoft Learn for more information).
Core
Added ONNX 1.16 support.
Added additional optimizations related to Dynamo-exported models.
Improved testing infrastructure for EPs developed as shared libraries.
Exposed Reserve() in OrtAllocator to allow custom allocators to work when session.use_device_allocator_for_initializers is specified.
... (truncated)
Commits
3871274 [ORT 1.18.1 Release] Update ORT numpy dependency to >=1.21.6,<2.0 (#21141)
Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.
Dependabot commands and options
You can trigger Dependabot actions by commenting on this PR:
- `@dependabot rebase` will rebase this PR
- `@dependabot recreate` will recreate this PR, overwriting any edits that have been made to it
- `@dependabot merge` will merge this PR after your CI passes on it
- `@dependabot squash and merge` will squash and merge this PR after your CI passes on it
- `@dependabot cancel merge` will cancel a previously requested merge and block automerging
- `@dependabot reopen` will reopen this PR if it is closed
- `@dependabot close` will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually
- `@dependabot show ignore conditions` will show all of the ignore conditions of the specified dependency
- `@dependabot ignore this major version` will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
- `@dependabot ignore this minor version` will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
- `@dependabot ignore this dependency` will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)
Bumps onnxruntime from 1.17.3 to 1.18.1.
Release notes
Sourced from onnxruntime's releases.
... (truncated)
Commits
3871274[ORT 1.18.1 Release] Update ORT numpy dependency to >=1.21.6,<2.0 (#21141)d0aee20[ORT 1.18.1 Release] Cherry pick 3rd round (#21129)8bfcf14[ORT 1.18.1 Release] update 1.18.1 patch release version (#21143)25ab935[ORT 1.18.1 Release] Cherry pick 2nd round (#21111)91fb865[ORT 1.18.1 Release] Cherry pick 1st round (#21105)4573740[ORT 1.18.0 Release] Cherry pick 3rd/Final round (#20677)ed349b9Mark end of version 17 and 18 C API (#20671)d72b476[ORT 1.18.0 Release] Cherry pick 2nd round (#20620)65f3fbf[ORT 1.18.0 Release] Cherry pick 1st round (#20585)204f1f5Run fuzz testing before the CG task cleans up the build directory (#20500) (#...Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting
@dependabot rebase.Dependabot commands and options
You can trigger Dependabot actions by commenting on this PR: - `@dependabot rebase` will rebase this PR - `@dependabot recreate` will recreate this PR, overwriting any edits that have been made to it - `@dependabot merge` will merge this PR after your CI passes on it - `@dependabot squash and merge` will squash and merge this PR after your CI passes on it - `@dependabot cancel merge` will cancel a previously requested merge and block automerging - `@dependabot reopen` will reopen this PR if it is closed - `@dependabot close` will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually - `@dependabot show