BoolQ for Training and Eval - Githubissues

fixie-ai / ultravox

MIT License

618 stars 24 forks source link

BoolQ for Training and Eval #30

Closed farzadab closed 1 week ago

farzadab commented 2 weeks ago

This PR adds:

Training version of BoolQ (extended with GPT-based "explanations")
True/False (exact match) evaluations for BoolQ
Text-only evaluations for BoolQ and AnyInstruct to show the text-audio gap