Needle In A Haystack test?

thunlp / InfLLM

The code of our paper "InfLLM: Unveiling the Intrinsic Capacity of LLMs for Understanding Extremely Long Sequences with Training-Free Memory"

MIT License

269 stars 21 forks source link

Open geekboood opened 4 months ago

geekboood commented 4 months ago

Any result with Needle In A Haystack test?

sunying2018 commented 4 months ago

I noticed there is an experiment mentioned in the paper to compare infllm and LM-Infinite in Needle In A Haystack test

Would you mind incorporating this Needle In A Haystack test into the evaluation part? Many thanks!