search

nomic-ai / gpt4all-chat

gpt4all-j chat
Other
1.27k stars 156 forks source link

Is there a way to hit the local instance programmatically via API or npm package? (FUTURE WISH) #53

Open contractorwolf opened 1 year ago

contractorwolf commented 1 year ago

I would love to run node services against this local instance if possible. Has anyone tried to do that yet?

AndriyMulyar commented 1 year ago

The software stack around gpt4all models is growing quickly. Please subscribe to the announcements channel in the discord for the latest updates. https://discord.gg/ax5T8eyC6a

Describe in more detail below what you are trying to do and it will be taken into account for prioritization!

contractorwolf commented 1 year ago

Yeah @AndriyMulyar much like chatGPT also has access to an API for GPT3.5 and 4 I would like to be able to ask the engine questions using JavaScript instead of using the electron(?) interface. I had hoped it was going to be running a normal web server so I could peek it the network traffic and figure out a way to hack a programmatic interface into it, but I don't know how to peek at an electron app. :/

manyoso commented 1 year ago

The GUI is Qt based not electron. There will be plugins including javascript, python and even a web REST interface yes in the future.

vRobM commented 1 year ago

Take a look at https://github.com/keldenl/gpt-llama.cpp which provides the API interface