search

hsiehjackson / RULER

This repo contains the source code for RULER: What’s the Real Context Size of Your Long-Context Language Models?
Apache License 2.0
321 stars 17 forks source link

Add answer_predfix to prevent model from refusing to answer typo? #20

Open vkaul11 opened 1 month ago

vkaul11 commented 1 month ago

Do you mean answer_prefix in README. Is this like forced_generation? Model can still refuse to answer.

hsiehjackson commented 1 month ago

We add answer prefix as the start tokens of assistant message. This can prevent model from refusing to answer.

vkaul11 commented 1 month ago

Yes I think there is typo saying answer_predfix which I think is a typo