search

huggingface / lighteval

Lighteval is your all-in-one toolkit for evaluating LLMs across multiple backends
MIT License
845 stars 100 forks source link

[FT] Open ai endpoint #273

Closed Pommel4711 closed 1 month ago

Pommel4711 commented 3 months ago

Evaluation Short Description

I am attempting to evaluate a model similar to ChatGPT using the OpenAI interface. Is there any way to accomplish this?

Why is this evaluation interesting?

This evaluation is interesting because it would allow for the assessment of models like ChatGPT or custom models using the OpenAI interface.

How used is it in the community?

I believe many people will find this useful, as it can facilitate the evaluation of various models within the OpenAI ecosystem.

Evaluation Metadata

Provide all available resources:

clefourrier commented 1 month ago

Hi! We now support Open AI models here!