Add support for LLaMa 3 on Groq

lmos-ai / arc

The goal of the Arc project is to utilize the power of Kotlin DSL and Kotlin Scripting to define a language optimized for building LLM powered solutions.

https://www.telekom.com/imprint

66 stars 3 forks source link

Add support for LLaMa 3 on Groq #2

Open jozzy opened 6 months ago

jozzy commented 6 months ago

Groq being the fastest inference compute , add support for models hosted in Groq. LLaMa3

https://console.groq.com/docs/models

There is a similar request open in Spring AI https://github.com/spring-projects/spring-ai/issues/621

an approach to reuse such interrogations could also be thought through