Open sozercan opened 6 months ago
https://github.com/darrenburns/elia provides a nice tui
docker run -d --rm -p 8080:8080 ghcr.io/sozercan/llama3:8b
echo -e '[[models]]\nname = "openai/llama-3-8b-instruct"\napi_base = "http://localhost:8080"' >> ~/.config/elia/config.toml
elia -i "hello world" -m openai/llama-3-8b-instruct
What kind of request is this?
New feature
What is your request or suggestion?
support for interactive chat interface
https://github.com/charmbracelet/bubbletea/blob/master/examples/chat/main.go
https://github.com/mudler/LocalAI/issues/1535
Are you willing to submit PRs to contribute to this feature request?