Open guarin opened 5 days ago
Hello @guarin, please assign this issue to me.
Thanks for looking into it!
@guarin, while implementing this I see there is no probability parameters in AmplitudeRescaleTransform and PhaseShiftTransform. Should we add it or what is the workaround?
Hi, you can use the RandomApply
transform from torchvision
Add FDATransform based on Disentangling the Effects of Data Augmentation and Format Transform in Self-Supervised Learning of Image Representations.
The different subtransforms have already been added in https://github.com/lightly-ai/lightly/issues/1646 The goal now is to combine them all into a single FDATransform. Note that the image in the paper shows that the amplitude rescale and phase shift transforms are applied in parallel but we can implement them sequentially as the subtransforms handle the split into amplitude/phase components internally.
Tasks
Follow the BYOLTransform code on how to implement the different views and the full FDATransform: https://github.com/lightly-ai/lightly/blob/master/lightly/transforms/byol_transform.py
Each view transform must implement the following steps:
Parameters for view 1 and 2: