search

nuprl / MultiPL-E

A multi-programming language benchmark for LLMs
https://nuprl.github.io/MultiPL-E/
Other
201 stars 38 forks source link

Updated OpenAI Interface #76

Closed joydeep-b closed 1 year ago

joydeep-b commented 1 year ago

@arjunguha This allows the openai eval to be run locally (not on Azure), with just an API key.

arjunguha commented 1 year ago

I had simultaneously changed this code to take a list of prompts instead. Here is the simplest fix I came up with:

https://github.com/nuprl/MultiPL-E/commit/56f048a6bb19a38ce12016ebecfd25d5407f1658

And a little refactor:

https://github.com/nuprl/MultiPL-E/commit/2f54a8d7dda3e3271984e92ceb12f411c0491452

Looks good?

joydeep-b commented 1 year ago

Ah, looks good! Closing this issue.