Fix GenAI LM Eval Model API to be compatible with LM Eval HF model API

IBM / ibm-generative-ai

IBM-Generative-AI is a Python library built on IBM's large language model REST interface to seamlessly integrate and extend this service in Python programs.

Apache License 2.0

245 stars 101 forks source link

Status

READY

Description

Made LM Eval wrapper compatible with LM EVAL Huggingface wrapper. (in terms of default max_gen_tokens and truncation).

Impacted Areas in Library

LM Eval wrapper

Which issue(s) does this pull-request fix?

Any special notes for your reviewer?

Checklist

[ ] Automated tests exist
[ ] Updated Package Requirements (if required, and with maintainers' approval)
[ ] Local unit tests performed
[ ] Documentation exists [link]()
[ ] Local pre-commit hooks performed
[ ] Desired commit message set as PR title and description set above
[ ] Link to relevant GitHub issue provided