search

cztomsik / ava

All-in-one desktop app for running LLMs locally.
https://avapls.com
Other
419 stars 15 forks source link

Mobile app #6

Closed cztomsik closed 1 month ago

cztomsik commented 11 months ago

This has been requested multiple times.

I'm not sure if we can make real mobile app because the memory constraints are too tight... (Of course this will change eventually but still, the model will be toy when compared to what you can run at home)

But we could definitely work on a responsive version of the GUI and allow some easy way to self-host it over the SSH or something. That way you would have "mobile app" which still needs internet, but you know all the data always stay on your computer (which needs to be running at home).

By easy way I mean having a button or some configuration screen in Settings. Because you can already do ssh -D xxx right now and it will work but many people don't know about this.

3kwa commented 11 months ago

responsive version of the GUI hitting the self hosted API endpoints (as they mature) leveraging tailscale for the safe bridge between mobile and host

cztomsik commented 1 month ago

Not planned in the short term.