apocas / restai

RESTai is an AIaaS (AI as a Service) open-source platform. Built on top of LlamaIndex & Langchain. Supports any public LLM supported by LlamaIndex and any local LLM suported by Ollama/vLLM/etc. Precise embeddings usage and tuning. Built-in image generation (Dall-E, SD, Flux) and dynamic loading generators.
https://apocas.github.io/restai/
Apache License 2.0
388 stars 75 forks source link

Internal Server Error for router llama3b #91

Open sha-linimoorthy opened 2 months ago

sha-linimoorthy commented 2 months ago
image