Link-AGI / AutoAgents

[IJCAI 2024] Generate different roles for GPTs to form a collaborative entity for complex tasks.
https://huggingface.co/spaces/LinkSoul/AutoAgents
MIT License
1.15k stars 146 forks source link

Integrate with LM Studio #38

Open Squallpka1 opened 10 months ago

Squallpka1 commented 10 months ago

Try this on 'https://huggingface.co/spaces/LinkSoul/AutoAgents'. 4 chats and blew my 0.50 credit from OpenAI. Its just a test to see how this work.

I just wonder if we can have text box inside this huggingface site that use LM Studio because I use LM Studio and its such a very easy to get and use LLM. Its also have function as a local server. If i just can connect this IP server to the huggingface that you guys build there will be awesome.

TheMindExpansionNetwork commented 10 months ago

With you trying to figure it out

showkeyjar commented 10 months ago

I have been tried to integrate with LM Studio, it doesn't work as expected,

when it send role and plan info to LLMs, models returns nothing,

more funny, I also integrated AutoGPT with LM Studio, it still can not work,

because I found the model cannot accurately select actions, it cause AutoGPT can not found action to execute.

I use TheBloke/Llama-2-13B-chat-GGUF, maybe it has something to do with the model I chose.

Looking forward to more powerful models to choose from.