Psycoy / MixEval

The official evaluation suite and dynamic data release for MixEval.
https://mixeval.github.io/
196 stars 28 forks source link

Support for Azure OpenAI API? #12

Closed Ignoramus0817 closed 2 months ago

Ignoramus0817 commented 2 months ago

Does MixEval work with Azure OpenAI API (as judgement models)? Or how can I modify the codes to get it to work?

Psycoy commented 2 months ago

Hey Chiwei,

I have added the feature. Specify the --api_base_url if you wish to use other api such as llama.cpp server and Azure OpenAI API.

Ignoramus0817 commented 2 months ago

Thanks for adding the feature! Actually I closed it before as I found it easy to modify the codes to work with Azure, but having an official solution is always better :)