Closed tzolov closed 2 days ago
Also how to access multiple inference engines at once
@KotlinFactory can you please elaborate, what you mean by "multiple inference engines"?
Do you mean multiple Groq models or perhaps multiple Models across different providers?
Also can you provide some use cases to support such setup?
The Groq API provides high level of compatibility with the OpenAI API. The existing Spring AI OpenAI model client can be used to access the Groq inference API for most chat completion tasks. Provide documentation and instructions how to re-use the OpenAI Model Client for accessing the Groq chat completion endpoint.