search

lmstudio-ai / lmstudio-bug-tracker

Bug tracking for the LM Studio desktop application
9 stars 3 forks source link

Feature Request: Use LM Studio as a Client for a different LLM Server in the local Network. #133

Open B-l-u-e-f-i-r-e opened 1 month ago

B-l-u-e-f-i-r-e commented 1 month ago

LM Studio already allows to create a server and use it for api requests. But it does not allow LM Studio to act as a client for that Server.

Here is the scenario: I have one powerful machine in my local Network. Now I want to use the LLM on computers, that are in the network, which are not powerful enough to run the LLM. I should be able to add a local IP address (the one of the LLM Server) in LM Studio, and use it to access the LLM'S from a different computer truth LM Studio.

I was really confused that this was not possible, since LM Studio already has the ability to create a server.

YorkieDev commented 1 month ago

@B-l-u-e-f-i-r-e this is already possible in version 0.3.*: image

You will need to connect it to a front end that accepts an Open AI like API.

yagil commented 1 month ago

@YorkieDev the request is for the other way around: allow LM Studio to act as a client for another LM Studio server.

@B-l-u-e-f-i-r-e this is something that will be possible in a couple of releases from now, stay tuned (prep work here https://github.com/lmstudio-ai/lmstudio.js/pull/90)

B-l-u-e-f-i-r-e commented 1 month ago

@yagil Okay cool, I'm looking forward to that.

JPnux commented 1 month ago

Good news !!! for the same reason I am looking for the same feature !

orinker commented 3 weeks ago

Looking forward to that!! LMStudio has the cleanest interface tbh. And it's fasssst comparing to web UI. It's great to hear this feature is coming in a couple of release. Keep up the great work!