search

huggingface / optimum

🚀 Accelerate training and inference of 🤗 Transformers and 🤗 Diffusers with easy to use hardware optimization tools
https://huggingface.co/docs/optimum/main/
Apache License 2.0
2.56k stars 461 forks source link

Support better transformer option for ESV models #1153

Open mahdip72 opened 1 year ago

mahdip72 commented 1 year ago

When I use model = model.to_bettertransformer() in my code I got this error: The model type esm is not yet supported to be used with BetterTransformer.

Would you please support ESM-V2 family to optimum?

These models currently are the best available pre-trained protein language models for researchers.

mahdip72 commented 1 year ago

Any updates?

fxmarty commented 1 year ago

@mahdip72 Sure, would you like to submit a PR?

mahdip72 commented 1 year ago

Thank you @fxmarty for the quick response and the suggestion. I appreciate the opportunity to contribute. However, I'm not familiar with the codebase and the changes required to support the ESM-V2 family. I was hoping someone with more expertise in the project could take a look. I understand if it might take some time. Thank you for considering my request!

mahdip72 commented 1 year ago

Do you have any plan to support the aforementioned models in the near future?