psugihara / FreeChat

llama.cpp based AI chat app for macOS
https://www.freechat.run
MIT License
438 stars 41 forks source link

Satellite mode #52

Open psugihara opened 10 months ago

psugihara commented 10 months ago

It would be really cool to chat with my little local AIs on the go.

I'm thinking I check a box in the settings and it gives me a link to copy with a chat web UI in it. In the future, there could be a native mobile app + QR code but for now it could just be a basic web UI proof of concept.

I'd like to implement this with the smallest possible (open source) server component to relay messages. Hoping the service could be basically free via WebRTC.

I think WebRTC would be a good fit for piping messages between FreeChat running on your mac and the satellite UI. This project by @gfodor could be useful https://github.com/gfodor/p2pcf.