facebookresearch / esm

Evolutionary Scale Modeling (esm): Pretrained language models for proteins
MIT License
3.16k stars 627 forks source link

How to train LinearProjectionDistogramModel for my data? #655

Open hasaiki136 opened 8 months ago

hasaiki136 commented 8 months ago

Hello, thanks for your great work.

In your lm_design folder, there are two tasks - fixedbb and free_generation. For the first task, I want to change the weight for LinearProjectionDistogramModel to predict my proteins distance bins accurately. I tried to train the model on my protein data, with learning rate of 1e-2 using cce_loss (refer to your loss.py) between all [i, j] pairs in the predicted distogram and ground truth distogram. But didn’t get expected results.

So I hope to know the way you train the LinearProjectionDistogramModel, how you calculate the total loss and how to define the accuracy ?