Closed a-sajjad72 closed 1 month ago
👋 Hello @a-sajjad72, thank you for your interest in Ultralytics YOLOv8 🚀! We recommend a visit to the Docs for new users where you can find many Python and CLI usage examples and where many of the most common questions may already be answered.
If this is a 🐛 Bug Report, please provide a minimum reproducible example to help us debug it.
If this is a custom training ❓ Question, please provide as much information as possible, including dataset image examples and training logs, and verify you are following our Tips for Best Training Results.
Join the vibrant Ultralytics Discord 🎧 community for real-time conversations and collaborations. This platform offers a perfect space to inquire, showcase your work, and connect with fellow Ultralytics users.
Pip install the ultralytics
package including all requirements in a Python>=3.8 environment with PyTorch>=1.8.
pip install ultralytics
YOLOv8 may be run in any of the following up-to-date verified environments (with all dependencies including CUDA/CUDNN, Python and PyTorch preinstalled):
If this badge is green, all Ultralytics CI tests are currently passing. CI tests verify correct operation of all YOLOv8 Modes and Tasks on macOS, Windows, and Ubuntu every 24 hours and on every commit.
TFLite is not supposed to use GPU on export, this is not a bug.
TFLite is not supposed to use GPU on export, this is not a bug.
sorry @glenn-jocher I didn't get you. You mean the export process is done without GPU acceleration whether the TF detects GPU or not. Is it?
Correct, when exporting for TFLite, you should use device="cpu"
to ensure the correct device is used.
Correct, when exporting for TFLite, you should use
device="cpu"
to ensure the correct device is used.
@Burhan-Q would i ask why the exporting is done without GPU or is it possible to speed up the process? because when exporting it takes almost >18 minutes for yolov8m model to export for 320 image size.
@a-sajjad72 that's b/c there is no CUDA delegate (as far as I'm aware) for TFLite. They only build releases for mobile GPUs and not desktop GPUs, so export needs to be on CPU.
@a-sajjad72 that's b/c there is no CUDA delegate (as far as I'm aware) for TFLite. They only build releases for mobile GPUs and not desktop GPUs, so export needs to be on CPU.
ok. i got it. @glenn-jocher thanks for your assistance.
@a-sajjad72 you're welcome! If you have any more questions or need further assistance, feel free to ask.
Search before asking
YOLOv8 Component
Export
Bug
The yolo using
tensorflow 2.15.0
version for converting (exporting) a model totflite
which is out of support and can't use GPU. Due to which I takes lot of time for exporting the model sometime my free runtime runs out. I don't know how to specify theTF
package to be used. Currenlty onlyTF 2.17 rc1
is supporting GPU. Have a look here if you need anymore info please let me know. Thank youEnvironment
Environment: Google Colab Notebook
Output of the export command
Minimal Reproducible Example
ultralytics installation
%pip install ultralytics
export command !yolo export format=tflite model=/path/to/your/best.pt imgsz=320 int8Additional
No response
Are you willing to submit a PR?