feat: Added image prefetching option to Openfire

pyronear / pyro-vision

Computer vision library for wildfire detection 🌲 Deep learning models in PyTorch & ONNX for inference on edge devices (e.g. Raspberry Pi)

https://pyronear.org/pyro-vision/

Apache License 2.0

52 stars 24 forks source link

Closed frgfm closed 2 years ago

frgfm commented 2 years ago

This PR introduces the following modifications:

fixes the progress bar of parallel
refactors OpenFire as an ImageFolder (pyrovision)
adds a prefetch mechanism to prevent RAM overload: each image is read and resized to a reasonable shape to avoid RAM overload at training time (some images of OpenFire are actually massive)
adds this option in references
extends unittests of OpenFire
refined typing of OpenFire and parallel

Any feedback is welcome!