Support for Azure OpenAI client

openai / evals

Evals is a framework for evaluating LLMs and LLM systems, and an open-source registry of benchmarks.

Other

14.36k stars 2.55k forks source link

Support for Azure OpenAI client #1469

Open pkt1583 opened 4 months ago

pkt1583 commented 4 months ago

Describe the feature or improvement you're requesting

Currently evals framework does not support Azure openAI implementation. This is blocker if someone wants to use eval with Azure OpenAI implementation.

Additional context

No response

### Tasks
- [ ] https://github.com/openai/evals/pull/1470

akash-pratap-singh commented 3 months ago

I understand that the solution has been implemented but how do I use this feature.

pkt1583 commented 3 months ago

The PR is still pending for approval