search

hsiehjackson / RULER

This repo contains the source code for RULER: What’s the Real Context Size of Your Long-Context Language Models?
Apache License 2.0
321 stars 17 forks source link

Why is multi_key_2 and 3 with only 1 key? #8

Closed jzhang38 closed 2 months ago

jzhang38 commented 2 months ago

https://github.com/hsiehjackson/RULER/blob/a8a797a06eed8eb871c5e20e734714926316b536/scripts/synthetic.yaml#L61

hsiehjackson commented 2 months ago

We already set type_haystack=needle, so the context are filled with distracted needles.