How to add Azure api key and endpoint and how to access gpt models based on that.

carlini / yet-another-applied-llm-benchmark

A benchmark to evaluate language models on questions I've previously asked them to solve.

GNU General Public License v3.0

875 stars 64 forks source link

How to add Azure api key and endpoint and how to access gpt models based on that. #25

Open sudhanshu-myl opened 5 days ago

sudhanshu-myl commented 5 days ago

Hi, I am able to access openai key and access gpt models through that. I have azure endpoints (api key and base_url). How do I configure that top access gpt based models?

carlini commented 5 days ago

You'll need to write an interface that connects this project up to Azure. You can see this PR for someone who added a new endpoint (#17), or reference some of the other files that do this

https://github.com/carlini/yet-another-applied-llm-benchmark/blob/a35d306f34d9f5785e60587f175edeaad5c38862/llms/anthropic_model.py

I've never used Azure before but it looks like azure-ai-ml might be what you want to use.