search

UKGovernmentBEIS / inspect_ai

Inspect: A framework for large language model evaluations
https://inspect.ai-safety-institute.org.uk/
MIT License
565 stars 96 forks source link

Is there any way to run this with model from Azure OpenAI #34

Closed Sandy8103 closed 3 months ago

Sandy8103 commented 3 months ago

We are using Azure OpenAI model that endpoint is deployed into Azure. Is there any way evaluate the LLM model/service? Thanks!

aisi-inspect commented 3 months ago

Yes, definitely! Here are the docs on that: https://ukgovernmentbeis.github.io/inspect_ai/models.html#azure-ai