search

PicoMLX / PicoMLXServer

The easiest way to run the fastest MLX-based LLMs locally
MIT License
207 stars 15 forks source link

Models/servers are not persisted between launches #4

Open sejmann opened 6 months ago

sejmann commented 6 months ago

I haven't been able to get server configs to persist between launches of PicoMLXServer, and have had to recreate each server each time. I did briefly try to look through the code, and saw UserDefaults was used for preferences, but not (at least not obviously) for servers, and confirmed the contents of ~/Library/Preferences/com.starlingprotocol.PicoMLXServer.plist did not contain model/server info. Nothing stored in ~/Library/Application Support, either.

ronaldmannak commented 6 months ago

I'm reworking server management in the next version. Will add persistency.