songlab-cal / tape-neurips2019

Tasks Assessing Protein Embeddings (TAPE), a set of five biologically relevant semi-supervised learning tasks spread across different domains of protein biology. (DEPRECATED)
https://arxiv.org/abs/1906.08230
MIT License
118 stars 34 forks source link

How Bepler's Multitask Model trained #20

Open DaHaiHuha opened 4 years ago

DaHaiHuha commented 4 years ago

Hi, I found there are well-defined Bepler's supervised pre-training tasks and the released model weights. But I'm really confused about how was it trained? Because I could not find a task that combine the original two supervised tasks.

If anybody has any suggestions, thanks in advance!