An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.
36.56k
stars
4.51k
forks
source link
Make logprobs accessible for chat completions with the OpenAI API #3422
Closed
BastienLeGuellec closed 3 months ago
Why are these changes needed?
At the moment, logprobs are not accessible for chat completions with the OpenAI API. It is on the todo list from the docs section.
Checks
format.shto lint the changes in this PR.I hope the changes are straightforward enough not to cause any issue.