search

libffcv / ffcv

FFCV: Fast Forward Computer Vision (and other ML workloads!)
https://ffcv.io
Apache License 2.0
2.81k stars 180 forks source link

Albumentations #201

Closed RocketFlash closed 2 years ago

RocketFlash commented 2 years ago

Hi! Is it possible to use ffcv with albumentations transformations ? As I understand .beton files consist of already transformed and saved instances. Is it possible to use transformations in real time manner?

GuillaumeLeclerc commented 2 years ago

.beton files do not consist of already transformed and saved instances otherwise it would be impossible to do random augmentations at train.

Some people have used albumentations augmentations with FFCV but I would recommend against if your goal is pure performance as they will only run with single worker. Augmentations are usually very simple procedure (a couple of lines of numpy). I recommend implementing them in numpy and integrate them as FFCV transforms, this will get the best performance