search

lmstudio-ai / lmstudio-bug-tracker

Bug tracking for the LM Studio desktop application
10 stars 3 forks source link

Non-working Headless Support #187

Open chrisspen opened 2 weeks ago

chrisspen commented 2 weeks ago

The docs claim that LM Studio can run headless. However, the docs start by explaining how to configure this headless support...by running the desktop app...in a desktop.

To enable this, head to app settings (Cmd / Ctrl + ,) and check the box to run the LLM server on login.

I'm supposed to enable headless functionality by opening the gui tool in on a headless server? Am I missing something?

The page describing how to "serve on the local network" is literally missing:

Screenshot from 2024-11-04 14-03-11

The server containing my GPUs is headless. How do I install LM Studio on it completely from the command line. The docs on how to do this are missing. Does LM Studio have no actual headless support?

Lutanist228 commented 6 days ago

I've been shipping through the whole net and finally found some clues which may help you with your problem:

  1. Check whether yor LM Studio AppImage is 0.3.5 version (headless mode starts from this version);
  2. Extract the image via ./LM_Studio-*.AppImage --appimage-extract;
  3. Once the squashfs-root has been created, your goal is to find "lms" file hidden somewhere deep inside this root;
  4. The final step is to just execute lms file;

Here is label which indicates that lms file is working correctly image