Fix DDP hang in voxel2clip, support using test set as validation, and add mixco+image aug to e2e

MedARC-AI / fMRI-reconstruction-NSD

fMRI-to-image reconstruction on the NSD dataset.

MIT License

294 stars 39 forks source link

Closed jimgoo closed 1 year ago

jimgoo commented 1 year ago

Fix a bug where voxel2clip hangs inside mixco loss when using DDP during validation (set distributed=False there)
Support running with the test set as the validation set and the train + val sets as the training set (test_is_val kwarg for utils.get_dataloaders.)
Add mixco and image augmentation to the e2e training script