dongyangli-del / EEG_Image_decode

Using vision-language models to decode natural image perception from non-invasive brain recordings.
MIT License
60 stars 14 forks source link

Confusion about the test images path #16

Closed generic111 closed 15 hours ago

generic111 commented 1 week ago

In your data_config.json in the Generation folder, the "img_directory_test" points to "/home/ldy/Workspace/Generation/generated_imgs".

Does this mean that img_directory_test should point to the generated images by the model? Or does it just point to the folder with the test images?

koro-github commented 1 week ago

Just point to the folder of test images

dongyangli-del commented 1 week ago

Hi, @generic111, if you need to test the performance of image reconstruction, you need to set img_directory_testto generated_imgs, otherwise Just point to the folder of test images.

koro-github commented 1 week ago

thanks you answer,dongyang. I can't find the difference between ATM_S_insubject_retrieval.py and ATM_S_insubject_classification.py. One of them is retrieval and the other is classification. What's the difference in the code. there model 、acc_compute、dataset are same. ATM_S_insubject_classification.py 4dffb4e6a25e332b44f10d189d2e44a

ATM_S_insubject_classification.py a26f4edf40dfdc87db5f2cbe9e79657

dongyangli-del commented 1 week ago

Hi, @koro-github , our paper clearly points out the difference between retrieval tasks and classification tasks, namely: The retrieval task uses image features to calculate similarity during the test phase, while the classification task uses text features during the test phase. The representation alignment training process of the two is common, and both use image features to guide learning.

koro-github commented 1 week ago

Got it. Thank you

generic111 commented 1 week ago

Hi @dongyangli-del, to confirm when training the model in ATM_S_reconstruction_scale_0_1000.py, I set the path of "img_directory_test" to the actual test images and when I want to test the performance of the model i set it to the generated images directory?

dongyangli-del commented 1 week ago

Hi, @generic111, yes. If you need to test the performance of image reconstruction, you need to set img_directory_testto generated_imgs, otherwise Just point to the folder of test images.