Space AI service - EU LLM - Githubissues

alkem-io / alkemio

START HERE! Cross project collaboration and shared documentation.

European Union Public License 1.2

23 stars 4 forks source link

Space AI service - EU LLM #1336

Open bobbykolev opened 3 weeks ago

bobbykolev commented 3 weeks ago

Description

We need alternatives to the LLM, ideally open source and cost-effective.

Must have scope

[ ] An EU-based LLM, running with similar responses to the OpenAI's one.
[ ] Revise the embeddings model (detach from OpenAI).

Additional info: LLMs to test:

Mistral (open and closed)
Groq (LPU)

Unknown - LLM response quality? Limitations - language support?

https://docs.mistral.ai/getting-started/models/