search

waylaidwanderer / PandoraAI

PandoraAI is a web chat client powered by node-chatgpt-api, allowing users to easily chat with multiple AI systems while also offering support for custom presets. With its seamless and convenient design, PandoraAI provides an engaging conversational AI experience.
https://github.com/waylaidwanderer/node-chatgpt-api
MIT License
840 stars 217 forks source link

Support for Gpt4all REST API #174

Open anthonyronda opened 12 months ago

anthonyronda commented 12 months ago

Is your feature request related to a problem? Please describe. I am trying to access the local LLM running on my PC from other devices. I am using Gpt4all, which provides a REST API, but doesn't provide a web client that can access it.

Describe the solution you'd like A clear and concise description of what you want to happen. As an alternative to using node-chatgpt-api, modify the code to also allow use of gpt4all-api https://github.com/nomic-ai/gpt4all/tree/main/gpt4all-api

Describe alternatives you've considered A clear and concise description of any alternative solutions or features you've considered.

Additional context Add any other context or screenshots about the feature request here. I am willing to write my own implementation and contribute it to the project if I can get a push in the right direction to help me get started.

Richard-Weiss commented 11 months ago

@anthonyronda I've implemented using Local LLMs with node-chatgpt-api and the LM Studio inference server.
You can take a look at my forks:
https://github.com/Richard-Weiss/node-chatgpt-api https://github.com/Richard-Weiss/PandoraAI

But maybe it's enough for you to change the completionsURL in the ChatGPTClient file.