RESTai is an AIaaS (AI as a Service) open-source platform. Built on top of LlamaIndex & Langchain. Supports any public LLM supported by LlamaIndex and any local LLM suported by Ollama/vLLM/etc. Precise embeddings usage and tuning. Image generation (Dall-E, SD, Flux).
Adds .dockerignore (copied values from .gitignore)
Add redis service
Builds frontend as separate stage
Builds backend as separate stage to benefit from dependency caching
Adds support for postgres as a database backend
Configures postgres container in docker-compose.yml
Updates readme to include docker instructions
Issues
closes #75
closes #77
There was an issue when transferring embeddings this is due to our cache being mounted from the local filesystem, for this we will be creating a new volume specifically for the cache folder, the permissions are inherited from the already existing cache folder at the time the volume is mounted, for more specific permissions manually assign them during the build process in the restai service Dockerfile
Changes:
Issues
closes #75
closes #77
There was an issue when transferring embeddings this is due to our cache being mounted from the local filesystem, for this we will be creating a new volume specifically for the cache folder, the permissions are inherited from the already existing cache folder at the time the volume is mounted, for more specific permissions manually assign them during the build process in the restai service Dockerfile