Great Apes Classification Task

[leannmlindsey]

I could not find any detail about the "great apes classification task". This is not the same species classification task used in the HyenaDNA paper and so I am curious as to the number of species you used, and how related they were. I am also curious as to why you did not compare the HyenaDNA 7M parameter model with the Mamba 7M parameter model (They have one listed in Table 4.3 Chromatin Profile Prediction).

[albertfgu]

The task details are described in Sections 4.3.3 and Appendix E.3.4. We did not use a 7M Hyena model with context length 1M because we trained all these models from scratch and it was not necessary for our comparisons. Our comparisons are between

• Hyena 1.4M vs Mamba 1.4M, to show the difference in architecture controlling for model size
• Mamba 1.4M vs 7M, to show the scaling properties

[leannmlindsey]

Thank you so much. Sorry that I missed that on my first reading of the paper!