psugihara / FreeChat

llama.cpp based AI chat app for macOS
https://www.freechat.run
MIT License
402 stars 34 forks source link

Satellite mode #52

Open psugihara opened 5 months ago

psugihara commented 5 months ago

It would be really cool to chat with my little local AIs on the go.

I'm thinking I check a box in the settings and it gives me a link to copy with a chat web UI in it. In the future, there could be a native mobile app + QR code but for now it could just be a basic web UI proof of concept.

I'd like to implement this with the smallest possible (open source) server component to relay messages. Hoping the service could be basically free via WebRTC.

I think WebRTC would be a good fit for piping messages between FreeChat running on your mac and the satellite UI. This project by @gfodor could be useful https://github.com/gfodor/p2pcf.