Add support for starting & changing models through UI

getumbrel / llama-gpt

A self-hosted, offline, ChatGPT-like chatbot. Powered by Llama 2. 100% private, with no data leaving your device. New: Code Llama support!

https://apps.umbrel.com/app/llama-gpt

MIT License

10.73k stars 696 forks source link

Open ParthJadhav opened 11 months ago

ParthJadhav commented 11 months ago

This PR adds support for switching & starting models directly from the UI.

Major changes include:

Splitting the run-mac.sh into two separate shell files.
- run-mac-api.sh : To run the model.
- run-mac-ui.sh : To run the UI.
Create a new model-manager-service. It's an express server which starts & manages the AI models using API endpoints. These endpoints are queried from frontend to change the models.