ultralytics / ultralytics

NEW - YOLOv8 🚀 in PyTorch > ONNX > OpenVINO > CoreML > TFLite
https://docs.ultralytics.com
GNU Affero General Public License v3.0
23.76k stars 4.74k forks source link

Optimize NVIDIA Jetson Docs #11242

Closed lakshanthad closed 1 week ago

lakshanthad commented 2 weeks ago

@glenn-jocher

Now all model exports are working with NVIDIA Jetson Orin.

🛠️ PR Summary

Made with ❤️ by Ultralytics Actions

🌟 Summary

Updates and enhancements for NVIDIA Jetson setup and Parking Management documentation.

📊 Key Changes

🎯 Purpose & Impact

codecov[bot] commented 1 week ago

Codecov Report

All modified and coverable lines are covered by tests :white_check_mark:

Project coverage is 69.66%. Comparing base (40e5ac3) to head (f29cdb7).

Additional details and impacted files ```diff @@ Coverage Diff @@ ## main #11242 +/- ## ========================================== - Coverage 70.66% 69.66% -1.01% ========================================== Files 122 122 Lines 15591 15591 ========================================== - Hits 11018 10862 -156 - Misses 4573 4729 +156 ``` | [Flag](https://app.codecov.io/gh/ultralytics/ultralytics/pull/11242/flags?src=pr&el=flags&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=ultralytics) | Coverage Δ | | |---|---|---| | [Benchmarks](https://app.codecov.io/gh/ultralytics/ultralytics/pull/11242/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=ultralytics) | `35.38% <ø> (-0.26%)` | :arrow_down: | | [GPU](https://app.codecov.io/gh/ultralytics/ultralytics/pull/11242/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=ultralytics) | `37.36% <ø> (ø)` | | | [Tests](https://app.codecov.io/gh/ultralytics/ultralytics/pull/11242/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=ultralytics) | `65.10% <ø> (-1.65%)` | :arrow_down: | Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=ultralytics#carryforward-flags-in-the-pull-request-comment) to find out more.

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.

johnnynunez commented 1 week ago

If you want compile onnxruntime-gpu for jetson. @glenn-jocher I've some tutorials https://hackmd.io/ZmWQz8azTdWNVoCc9Bf3QA?view and Dustin upload whl: http://jetson.webredirect.org/

git clone --recursive https://github.com/microsoft/onnxruntime
cd onnxruntime 

export PATH="/usr/local/cuda-12.4/bin:${PATH}"
export CUDACXX="/usr/local/cuda-12.4/bin/nvcc"

pip3 install -U packaging
./build.sh --config Release --update --build --parallel --build_wheel \
--use_tensorrt --cuda_home /usr/local/cuda-12.4 --cudnn_home /usr/lib/aarch64-linux-gnu \
--tensorrt_home /usr/lib/aarch64-linux-gnu
image
lakshanthad commented 1 week ago

@Burhan-Q @glenn-jocher Thank you for reviewing. I have made the changes accordingly. It should be ready to merge now.

glenn-jocher commented 1 week ago

@lakshanthad looks much better, thanks for the fixes!!

glenn-jocher commented 1 week ago

@lakshanthad @Burhan-Q PR merged! Nice work here guys!

lakshanthad commented 1 week ago

Thank you @glenn-jocher !