autogpt used local llm instead of gpt4 &gpt3.5

danikhan632 / Auto-GPT-Text-Gen-Plugin

Use oobabooga/text-generation-webui to power AutoGPT instead of OpenAi

MIT License

53 stars 7 forks source link

autogpt used local llm instead of gpt4 &gpt3.5 #10

Open elven2016 opened 1 year ago

elven2016 commented 1 year ago

hello, thanks your solution for the local llm deploy in autogpt, when i installed it , follow the Readme, some steps not clear, and i can not test it sucess , is there needs to provides the openai keys in .env file if i used the text-generation-webui api ?
v

norton-chris commented 12 months ago

I just used an OpenAI key, and it's not charging anything to my account. Let me know if you found a way to not include the OpenAI key. I also found it difficult to set up the plugin, as the Readme wasn't super clear. Currently, the program crashes when getting a response from any of my local models. I posted an issue, but seeing as yours didn't get a response in the last couple monthes, I'm not sure I'll get any help either. :/