mims-harvard / TDC

Therapeutics Commons (TDC-2): Multimodal Foundation for Therapeutic Science
https://tdcommons.ai
MIT License
984 stars 173 forks source link

bad performance of MLP on drug synergy prediction task #202

Closed kkhuang1997 closed 1 year ago

kkhuang1997 commented 1 year ago

Describe your question.

Hi, with the purpose to reproduce results of drug synergy prediction task, i.e., https://github.com/mims-harvard/TDC/tree/main/examples/multi_pred/drugcombo, i run through the example code. However, the results look bad in terms of unchanged loss and validation MAE.

(just show the first two rounds) image

I noticed that another similar issue was proposed, https://github.com/mims-harvard/TDC/issues/169, and suspected bad performance of MLP on this task.

Any advice on how to choose a proper model to deal with this task?

Many thanks!

futianfan commented 1 year ago

thanks for your interest! Maybe you could try other neural architectures to get a more powerful representation, e.g., 1D-CNN or transformer for 1D SMILES string and graph neural network for drug molecular graph.

kexinhuang12345 commented 1 year ago

closing for now, feel free to reopen if question remains!