search

nvtransfer / RULER

This repo contains the source code for RULER: What’s the Real Context Size of Your Long-Context Language Models?
Apache License 2.0
646 stars 43 forks source link

Tempate for Yi? #13

Closed liyucheng09 closed 5 months ago

liyucheng09 commented 5 months ago

Great job for this project!

Can we have the template you used for the evaluation of Yi? Or did you simply use the meta-chat for Yi?

Please let me know for the sake of reproducibility!

hsiehjackson commented 5 months ago

@liyucheng09 we use "base" template without any special tokens for the evaluation of Yi.

liyucheng09 commented 5 months ago

Thanks for your response. I tried meta-chat and found only minor divergence.