search

josejg / instruction_following_eval

Instruction Following Eval
Apache License 2.0
4 stars 2 forks source link

broken script #1

Open Xiang-Pan opened 2 months ago

Xiang-Pan commented 2 months ago

1 from instruction_following_eval import default_examples, instruction_following_eval 3 examples = default_examples() 5 for example in examples:

ImportError: cannot import name 'default_examples' from 'instruction_following_eval'

josejg commented 1 month ago

Thanks for letting me know.

There was a recent change in the API - just reflected in the README (https://github.com/josejg/instruction_following_eval/commit/50413e10865090c74612a7a57ea25342cd891a9e)

The recent update also changes the data (this is because IFEval did the same), so if you want to stick to the old code and data, check out the v1 branch.