keras-team / keras-cv

Industry-strength Computer Vision workflows with Keras
Other
998 stars 329 forks source link

AutoAugment image augmentation #41

Closed innat closed 1 year ago

innat commented 2 years ago

Paper: https://arxiv.org/abs/1805.09501 Cited by 832 Ref code. https://github.com/tensorflow/models/blob/ded32f0500604928e52e27fd3f678e694e5133b7/official/vision/image_classification/augment.py#L731

LukeWood commented 2 years ago

I've been weighing adding this layer.

Thoughts on what it adds over RandAugment?

It looks as though it's much more customizable, which could be good to have.

@innat

bhack commented 2 years ago

I think that we could also evaluate differentiable augmentations like:

https://arxiv.org/abs/2104.04282 https://arxiv.org/abs/2109.15273 https://openreview.net/forum?id=St-53J9ZARf

innat commented 2 years ago

(AFAIK), the advantages of auto-augment over rand-augment also bring computational costs. I think both of them are used and maintained in research, so it's ok to have them both.

bhack commented 2 years ago

I think that we could also evaluate differentiable augmentations like: https://arxiv.org/abs/2104.04282 https://arxiv.org/abs/2109.15273 https://openreview.net/forum?id=St-53J9ZARf

/cc @haifeng-jin

LukeWood commented 2 years ago

this should probably use RandomAugmentationPipeline.

bhack commented 2 years ago

I think that we could also evaluate differentiable augmentations like: ..... https://openreview.net/forum?id=St-53J9ZARf

https://github.com/MSU-MLSys-Lab/DeepAA

LukeWood commented 2 years ago

I've received numerous inquiries about AutoAugment, so I definitely think we want this component.

bhack commented 1 year ago

Has https://github.com/keras-team/keras-cv/issues/900 was cloud I will unify the references on this ticket.

LukeWood commented 1 year ago

Lets deprioritize in favor of RandAugment; which serves a similar purpose but is much easier to tune.