zeno-ml / zeno-build

Build, evaluate, understand, and fix LLM-based apps
MIT License
482 stars 33 forks source link

add multiple generate functions #181

Closed lindiatjuatja closed 1 year ago

lindiatjuatja commented 1 year ago

Description

Add "multiple generate" versions of the generate functions in text_generate and chat_generate to support > 1 number of responses. Returns a list of list of strings, where each index of the outer list corresponds to a prompt. Currently only supports OpenAI models.

neubig commented 1 year ago

Thanks for contributing @lindiatjuatja ! It seems some checks are not passing. These will be caught and possibly automatically fixed by git pre-commit checks if you run:

pre-commit install
pre-commit run --all-files

Could you do this and update the PR?