search

jianxiangyu / MEOW

MIT License
24 stars 0 forks source link

Cannot reproduce the results in some dataset, and imbd data set was missing in meow. #2

Open Heycen opened 4 days ago

Heycen commented 4 days ago

Hi, thanks for reading this!

I cannot reproduce your results of the imdb and acm on adameow. image image

Do you have any hints on it? Is that caused by my hyperparameter setting?

At the same time, I found that the imbd was missing in meow's code. It would be great if you could provide it.

Thanks!

jianxiangyu commented 2 days ago

Thank you for your attention to our work. I reran the code in the repository and was able to obtain the desired results. The main reason for the difference in results is due to the initialization of the model parameters, which may be caused by different machines and different GPUs. I suggest you adjust the hyperparameters to improve the results.

Additionally, I have updated the hyperparameters for meow on the IMDB dataset, which you can use as a reference.