angelolab / Nimbus

Other
12 stars 1 forks source link

Image augmentation pipeline #8

Closed JLrumberger closed 2 years ago

JLrumberger commented 2 years ago

Section 1: Design details

We want to have an image augmentation pipeline that randomly transforms the images. PR #9

Relevant background

DL models are known to become more robust and overfit less when augmentations are used during training. Thus we want to have an augmentation pipeline that applies spatial and intensity augmentations onto images and solely spatial augmentations on the masks.

Design overview

Design list/flowchart

Required inputs

Output files

Intermediate output: augmentation pipeline object of class imagaug.augmenters.Sequential Final output: augmented images (np.array, dtype=float32) B x H x W x C and masks (np.array, dtype=uint8/16) B x H x W x C

Section 2: Implementation details

Control flow

Images need to be interpolated with bilinear interpolation, masks need to be interpolated with nearest-neighbor interpolation, otherwise the they will contain label values that weren't there before.

Milestones and timeline

Ready for review.