Trouble reproducing Nucleotide Transformer Benchmarks Result

HazyResearch / hyena-dna

Official implementation for HyenaDNA, a long-range genomic foundation model built with Hyena

https://arxiv.org/abs/2306.15794

Apache License 2.0

532 stars 74 forks source link

Closed yair-schiff closed 6 months ago

yair-schiff commented 6 months ago

Similar question to #37 :)

I am using LongSafari/hyenadna-tiny-1k-seqlen-d256 and trying to reproduce the results from Table 4.2 (Nucleotide Transformer Benchmarks).

Are you able to specify which hyperparams from Table A.5 were used to get the best results for each NT task for HyenaDNA (1.6 M)

exnx commented 6 months ago

It's in the docker image.

yair-schiff commented 6 months ago

Thanks! Sorry I missed that in the README