search

youngeun1209 / NeuroTalk

MIT License
44 stars 6 forks source link

Failing to reproduce similar results like the demo #5

Open samin9796 opened 6 months ago

samin9796 commented 6 months ago

Hi! I am trying to evaluate the pre-trained model for spoken EEG using the test samples, however, the outcome is not nearly as good as the demo (very far away). Could you please ensure that the original config files (used for the pre-trained model) was shared in this repo? Any pointer on why reproducing similar results is not being possible would be highly appreciated!

Thank you so much!

youngeun1209 commented 6 months ago

Thank you for having an interest in our study! We could not find the problem yet, but could you please confirm that you are using 'eval.py' for evaluating the model?

samin9796 commented 6 months ago

@youngeun1209 Thank you for your reply.

Yes, I used the 'eval.py' for evaluating the model. Just to point out, there is no "--trained_model" argument in eval.py, so I used the "model_config" argument instead to avoid the error.

youngeun1209 commented 2 months ago

You can place the trained model in 'loc_g' according to the arguments of logDir, sub, and task.