farizrahman4u / loopgpt

Modular Auto-GPT Framework
MIT License
1.43k stars 131 forks source link

Compatibility with Other Language Models #48

Open astrobenhart opened 1 year ago

astrobenhart commented 1 year ago

⚠️ Please check that this feature request hasn't been suggested before.

πŸ”– Feature description

Open AIs ChatGPT is a fantastic tool for this application but is there any development towards using a locally hosted language model like Dolly or Vicuna?

βœ”οΈ Solution

I'd have to look through the code more but a locally hosted server could act like an API to ease swapping out ChatGPT API. If the code uses OOP maybe another module for making requests would be enough and another class for local models, or that's on the user to setup with templates responses required by loopGPT?

❓ Alternatives

No response

πŸ“ Additional Context

Generally I'd like to use this to aid research for commercial projects that are data sensitive.

Acknowledgements