Benchmarks against Nvidia DALI

albumentations-team / albumentations

Fast and flexible image augmentation library. Paper about the library: https://www.mdpi.com/2078-2489/11/2/125

https://albumentations.ai

MIT License

13.99k stars 1.63k forks source link

Benchmarks against Nvidia DALI #408

Open mratsim opened 4 years ago

mratsim commented 4 years ago

Nvidia DALI is currently probably the fastest data augmentation library all around, especially for jpeg's image as those can be directly decompressed on GPU.

All their augmentations are implemented using either C++/Cuda C++ or the C++ OpenCV API so without any Python overhead as well.

Benches against DALI CPU and DALI GPU for the relevant augmentations would be nice: https://github.com/NVIDIA/DALI

vdaita commented 4 years ago

It really helps if you are augmenting large dataset in something like Google Colab, and you are able to use this with the GPU to accelerate your augmentations, it really helps.

ismael-elatifi commented 3 years ago

+1 for this very good suggestion ! It would be interesting to see the speed comparison between Albumentations and DALI at least for the most common augmentations. It think it would be also useful to compare entire typical augmentation pipelines and not just individual augmentations.