snap-stanford / GEARS

GEARS is a geometric deep learning model that predicts outcomes of novel multi-gene perturbations
MIT License
189 stars 38 forks source link

Questions about reproduction of Figure2cd #51

Closed zhoummmin closed 6 months ago

zhoummmin commented 6 months ago

Hi, Thank you for publishing such an excellent paper! I'm trying to reproduce the results of Figure2c and 2d. In the GEARS_misc/paper/Fig2cd.ipynb, I noticed that the color_pal is directly input. Could you please provide any guidance on how to reproduce these data and how could I get the perturbation results for all genes? Forgive me for my inexperience, thank you and have a nice day!

image
zhoummmin commented 6 months ago

I apologize for the inconvenience once again. Could you kindly verify whether the data location in this notebook is still accurate? I seem to have encountered some file non-existence problems during operation. May I inquire if it would be possible to communicate with you via email? I eagerly await your response. Thank you very much for your consideration!

image
yhr91 commented 6 months ago

Thanks for your question

color_pal in GEARS_misc/paper/Fig2cd.ipynb just refers to the color palette for the figures and is manually set. It does not refer to the experimental results.

To reproduce the results for GEARS on your own, you can follow this notebook

To plot the results you can point it at your own wandb account where the results from your run would be saved. Otherwise the wandb project linked in the notebook could also be used for the Norman dataset but not for the other two. However, it shouldn't take long to manually regenerate the results for adamson2016 and dixit2016 if you follow the notebook.

Let me know if that didn't answer your questions of if you have any other questions.