MedARC-AI / fMRI-reconstruction-NSD

fMRI-to-image reconstruction on the NSD dataset.
MIT License
307 stars 44 forks source link

Optional img2img input for diffusion reconstruction #4

Closed PaulScotti closed 1 year ago

PaulScotti commented 1 year ago

updated my jupyter notebook with jimgoo’s latest contributions, also fixed problem with wandb executing for each gpu instead of just the master gpu (but only for my notebook, not jimgoo's _combo.py script)

utils.reconstruct_from_clip() is an alternative to utils.sample_images() that can take img2img reference input, as used in the Brain_to_Image scripts.

grid of images now has white background and legible plot titles

I kept the train_combined.py unchanged and didnt mess with it so as to preserve others workflows, although it would still need to be adapted to handle the new img2img feature

added rng seed to data loaders

allow user to specify num_train in get_dataloaders() via num_samples argument (useful if wanting to not use the full dataset, for testing purposes)

separated jimgoo’s main-conda.slurm from my main-singularity.slurm