jzhang38 / EasyContext

Memory optimization and training recipes to extrapolate language models' context length to 1 million tokens, with minimal hardware.
Apache License 2.0
529 stars 33 forks source link

LongBench/InfiniteBench #16

Closed sunying2018 closed 2 months ago

sunying2018 commented 2 months ago

Hi,

Great work! I'm wondering if there is any benchmark tests conducted for long context bench such as LongBench or InfiniteBench to incorporate multiple types of tasks?