MedARC-AI / fMRI-reconstruction-NSD

fMRI-to-image reconstruction on the NSD dataset.
MIT License
294 stars 39 forks source link

Some results becoming gray #40

Closed Maxwells-Demons closed 8 months ago

Maxwells-Demons commented 8 months ago

Hi! Thanks for your wonderful project! But I encountered a problem: After I retraining MindEye, I set recons_per_sample=4 to reconstruct images. And some of the results are becoming gray: rua_80 rua_12 rua_55 However, it didn't happen when I use the released weights in huggingface. Do you have any idea about this? Whether I made mistakes in training or reconstruction settings?

PaulScotti commented 8 months ago

Yeah I think it's due to image augmentation being set to True during model training (we had it False for the paper's results, but the codebase here has it set to True accidentally, I should revise this...)