groq / groq-python

The official Python Library for the Groq API
Apache License 2.0
353 stars 23 forks source link

Support for regular completion API (not ChatCompletion) #33

Open jinyongyoo opened 4 months ago

jinyongyoo commented 4 months ago

Hi, I was wondering if you would consider supporting regular completion API too so that we can provide raw prompts instead of relying on the chat completion format.

While chat completion style APIs are the norm, I think there are still edge cases were developers want full control of the prompt (e.g. passing a prefix for the assistant's output to ensure reliable generation).