apocas / restai

RESTai is an AIaaS (AI as a Service) open-source platform. Built on top of LlamaIndex & Langchain. Supports any public LLM supported by LlamaIndex and any local LLM suported by Ollama/vLLM/etc. Precise embeddings usage and tuning. Image generation (Dall-E, SD, Flux).
https://apocas.github.io/restai/
Apache License 2.0
383 stars 73 forks source link

LLM refactor #68

Closed apocas closed 8 months ago