search

i-am-bee / bee-agent-framework

The framework for building scalable agentic applications.
https://i-am-bee.github.io/bee-agent-framework/
Apache License 2.0
1.09k stars 106 forks source link

Add LMStudio adapter #71

Open Tomas2D opened 1 month ago

Tomas2D commented 1 month ago

Add LLM inference support for https://lmstudio.ai/

Implementation notes:

Implementation tips:

JanPokorny commented 1 month ago

Note that it's currently possible to use LM Studio with Bee through the OpenAI-compatible API (https://lmstudio.ai/docs/basics/server#openai-like-api-endpoints), in a similar way to Ollama. I haven't checked if it has limitations over the SDK, however.

Tomas2D commented 1 month ago

Then I wonder why their SDK (https://www.npmjs.com/package/@lmstudio/sdk) differs from Ollama / OpenAI SDK.