search

telekom / create-tsi

Create-tsi is a generative AI RAG toolkit which generates AI Applications with low code.
224 stars 27 forks source link

Ollama Llama3 8b support #8

Open andrej-schreiner opened 2 months ago

andrej-schreiner commented 2 months ago

Include support for ollama as alternative to TSI API key to allow full locaal serving. Use llama 3 8b on ollama as reference implementation.