transformers version forward compatibility

HazyResearch / hyena-dna

Official implementation for HyenaDNA, a long-range genomic foundation model built with Hyena

https://arxiv.org/abs/2306.15794

Apache License 2.0

574 stars 82 forks source link

transformers version forward compatibility #71

Open bviggiano opened 3 months ago

bviggiano commented 3 months ago

Small fix for the CharacterTokenizer implementation, which breaks in transformers 4.40.0

bviggiano commented 3 months ago

I tested this implementation with the code in the tutorial, and this now works on both transformers 4.26.1 (original HyneaDNA version) and transformers 4.40.0