search

bit-bots / YOEO

YouOnlyEncodeOnce - A CNN for Embedded Object Detection and Semantic Segmentation
GNU General Public License v3.0
21 stars 4 forks source link

Bump onnxruntime from 1.13.1 to 1.14.0 #81

Closed dependabot[bot] closed 1 year ago

dependabot[bot] commented 1 year ago

Bumps onnxruntime from 1.13.1 to 1.14.0.

Release notes

Sourced from onnxruntime's releases.

ONNX Runtime v1.14.0

Announcements

  • Building ORT from source will require cmake version >=3.24 instead of >=3.18.

General

  • ONNX 1.13 support (opset 18)
  • Threading
    • ORT Threadpool is now NUMA aware (details)
    • New API to set thread affinity (details)
  • New custom operator APIs
    • Enables a custom operator to wrap an entire model that is meant to be inferenced with an external API or runtime.
    • Details and example
  • Multi-stream Execution Provider refactoring
    • Improves GPU utilization by putting parallel inference requests on different GPU streams. Updated for CUDA, TensorRT, and ROCM execution providers
    • Improves memory efficiency by enabling GPU memory reuse across different streams
    • Enables Execution Provider developer to customize its stream implementation by providing "Stream" interface in ExecutionProvider API
  • [Preview] Rust API for ORT - not part of release branch but available to build in main.

Performance

  • Support of quantization with AMX on Sapphire Rapids processors
  • CUDA EP performance improvements:
    • Improve performance of transformer models and decoding methods: beam search, greedy search, and topp sampling.
    • Stable Diffusion model optimizations
    • Change cudnn_conv_use_max_workspace default value to be 1
  • Performance improvements to GRU and Slice operators

Execution Providers

  • TensorRT EP
    • Adds support for TensorRT 8.5 GA versions
    • Bug fixes
  • OpenVINO EP
    • Adds support for OpenVINO 2022.3
  • DirectML EP: DML 1.10.1 support
  • ROCm EP: 5.4 support and GA ready
  • [Preview] Azure EP - supports AzureML hosted models using Triton for hybrid inferencing on-device and on-cloud

Mobile

  • Pre/Post processing
    • Support updating mobilenet and super resolution models to move the pre and post processing into the model, including usage of custom ops for conversion to/from jpg/png
      • onnxruntime-extensions python package includes the model update script to add pre/post processing to the model
      • See example model update usage
    • Created onnxruntime-extensions packages for Android and iOS with DecodeImage and EncodeImage custom ops
    • Updated the onnxruntime inference examples to demonstrate end-to-end usage with onnxruntime-extensions package
  • XNNPACK
    • Added support for additional commonly used operators
    • Add iOS build support
      • XNNPACK EP is now included in the onnxruntime-c iOS package
    • Added support for using the ORT allocator in XNNPACK kernels to minimize memory usage

... (truncated)

Commits


Dependabot compatibility score

Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.

Dependabot commands and options
You can trigger Dependabot actions by commenting on this PR: - `@dependabot rebase` will rebase this PR - `@dependabot recreate` will recreate this PR, overwriting any edits that have been made to it - `@dependabot merge` will merge this PR after your CI passes on it - `@dependabot squash and merge` will squash and merge this PR after your CI passes on it - `@dependabot cancel merge` will cancel a previously requested merge and block automerging - `@dependabot reopen` will reopen this PR if it is closed - `@dependabot close` will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually - `@dependabot ignore this major version` will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself) - `@dependabot ignore this minor version` will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself) - `@dependabot ignore this dependency` will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)
dependabot[bot] commented 1 year ago

OK, I won't notify you again about this release, but will get in touch when a new version is available. If you'd rather skip all updates until the next major or minor version, let me know by commenting @dependabot ignore this major version or @dependabot ignore this minor version. You can also ignore all major, minor, or patch releases for a dependency by adding an ignore condition with the desired update_types to your config file.

If you change your mind, just re-open this PR and I'll resolve any conflicts on it.