Hi There, I am working on a research that involves exploreing log probabilities of LLMs. I see that this a variable for the models, although I this error when I call it: logprobs is not supported with this model'. Since these are open-source models, it would be fantastic to have access to the probabilities. Thanks!
Hi There, I am working on a research that involves exploreing log probabilities of LLMs. I see that this a variable for the models, although I this error when I call it:
logprobs
is not supported with this model'. Since these are open-source models, it would be fantastic to have access to the probabilities. Thanks!