:robot: The free, Open Source OpenAI alternative. Self-hosted, community-driven and local-first. Drop-in replacement for OpenAI running on consumer-grade hardware. No GPU required. Runs gguf, transformers, diffusers and many more models architectures. It allows to generate Text, Audio, Video, Images. Also with voice cloning capabilities.
jtwolfe
commented
1 week ago
Site is missing the WEBUI blocking env
https://github.com/mudler/LocalAI/blob/34ab442ce9ef2ef35e6cae4d5262b0210746d1c8/core/cli/run.go#L48