I am planning to add groq support into the constrained generation library outlines. https://github.com/outlines-dev/outlines
Outlines already has OpenAI support so the change should be very straightforward except for the following issue
The documentation for groq says the following features are not supported in the groq api
I am planning to add groq support into the constrained generation library outlines. https://github.com/outlines-dev/outlines Outlines already has OpenAI support so the change should be very straightforward except for the following issue
The documentation for groq says the following features are not supported in the groq api
logprobs logit_bias top_logprobs
https://console.groq.com/docs/openai
Is there an alternative way to adjust the logit probabilities in groq or is it currently not supported?