Add dali loader aug

[alphinside]

Type of changes

Please check the type of change your PR introduces: - [ ] Bugfix - [x] Feature - [ ] Code style update (formatting, renaming) - [x] Refactoring (no functional changes, no api changes) - [ ] Build related changes - [x] Documentation content changes - [ ] Other (please describe): ## What is the current behavior? No support yet for nvidia DALI augmentations - close #21 ## What is the new behavior?

• Added DALIDataLoader and nvidia_dali augmentation module

  • nvidia_dali augmentation module must be used with DALIDataLoader
  • DALIDataLoader can use other augmentation module, however if nvidia_dali augmentation module if specified in the experiment file, it must be in the first order
  • DALIDataLoader utilize ray library to paralelize external module augmentation for each batch sample

    Checklist

• [x] Unit tests pass locally with my changes
• [x] I have added tests that prove my fix is effective or that my feature works
• [x] I have added necessary documentation (if appropriate) in docs/modules/augmentation.md and data_loader.md
• [x] Any dependent changes have been merged and published in downstream modules
• [x] I have filled the [Unreleased] Changelog

[triwahyuu]

what is the difference between 'BasicDatasetWrapper' and 'DefaultDatasetWrapper'?

[alphinside]

what is the difference between 'BasicDatasetWrapper' and 'DefaultDatasetWrapper'?

BasicDatasetWrapper only do type checking and dataformat checking, DefaultDatasetWrapper add augmentation on it ( Pytroch style ) , while DALI add augmentation on the dataloader ( not recommended but visible )

[alphinside]

any further review guys? @alifahrri @triwahyuu