OpenBioML / protein-lm-scaling

Other
54 stars 15 forks source link

question to dynamic batch sizes #57

Open wangleiofficial opened 8 months ago

wangleiofficial commented 8 months ago

Glad to see this project, I am very interested in protein language models. Protein sequence lengths vary more than textual information. Building dynamic batch sizes should reduce hardware memory requirements. Is there any progress on this?