What is the need for is_icl parameter? - Githubissues

nvtransfer / RULER

This repo contains the source code for RULER: What’s the Real Context Size of Your Long-Context Language Models?

Apache License 2.0

646 stars 43 forks source link

What is the need for is_icl parameter? #25

Closed vkaul11 closed 3 months ago

vkaul11 commented 4 months ago

I see you set it to false https://github.com/hsiehjackson/RULER/blob/9964f2d7c679c3c7220dd9af44b35c7136795d21/scripts/data/synthetic/variable_tracking.py#L68 here but I don't know the purpose of this parameter.

hsiehjackson commented 4 months ago

This parameter helps add a demonstration in our samples. https://github.com/hsiehjackson/RULER/blob/main/scripts/data/synthetic/variable_tracking.py#L149