Code for Re-train ProtBert Model

agemagician / ProtTrans

ProtTrans is providing state of the art pretrained language models for proteins. ProtTrans was trained on thousands of GPUs from Summit and hundreds of Google TPUs using Transformers Models.

Academic Free License v3.0

1.13k stars 153 forks source link

Code for Re-train ProtBert Model #61

Closed pzhang84 closed 3 years ago

pzhang84 commented 3 years ago

Great work! Can you also share your code for pre-training ProtBert? Thanks in advance!

agemagician commented 3 years ago

Please, check: https://github.com/agemagician/ProtTrans/issues/11