search

groq / groq-python

The official Python Library for the Groq API
Apache License 2.0
353 stars 23 forks source link

Log Probabilities #25

Closed vvenkatesh-ML closed 4 months ago

vvenkatesh-ML commented 5 months ago

Hi There, I am working on a research that involves exploreing log probabilities of LLMs. I see that this a variable for the models, although I this error when I call it: logprobs is not supported with this model'. Since these are open-source models, it would be fantastic to have access to the probabilities. Thanks!

gradenr commented 4 months ago

Thanks for the feedback. We definitely want to support logprobs. I have sent this request to the product team.