HazyResearch / hyena-dna

Official implementation for HyenaDNA, a long-range genomic foundation model built with Hyena
https://arxiv.org/abs/2306.15794
Apache License 2.0
602 stars 83 forks source link

Addition to Transformers #3

Closed tanaymeh closed 1 year ago

tanaymeh commented 1 year ago

First of all, excellent work! This model holds so much promise!

Is this model already in hugging face transformers? If not, I would like to volunteer in adding this model to Hugging face Transformers framework so it can be used by researchers easily.

Thanks!

exnx commented 1 year ago

Hi heytanay, it’s not already there, and that would be amazing if you wanted to add it! We’re definitely up for supporting where we can, clarification, pointers, sharp bits if you need. Thanks so so much!!!

tanaymeh commented 1 year ago

Thanks for the reply @exnx, I opened an Issue and will be opening a PR soon. Let's make this work!

https://github.com/huggingface/transformers/issues/24659

exnx commented 1 year ago

Closing this due to stale issue + someone from Huggingface is actively working porting over HyenaDNA to their library!