search

wawawario2 / long_term_memory

A gradio web UI for running Large Language Models like GPT-J 6B, OPT, GALACTICA, LLaMA, and Pygmalion.
GNU Affero General Public License v3.0
308 stars 15 forks source link

Does this work with api? #9

Open FromCollin opened 1 year ago

FromCollin commented 1 year ago

I like this idea and hope it continues to grow - does it work with the api?

wawawario2 commented 1 year ago

So I tested it just now on the two API examples: streaming and no streaming and neither work since this extension only operates in chat mode at the moment. I'll make this clear in the limitations.

Thireus commented 1 year ago

Is there a way to make it work with the API using sessions?

DragonForgedTheArtist commented 1 year ago

Having dug pretty deep into the api to the point of having 3 characters talking to each other, Here are my findings on making this available to the API. Your characters aren't available to the API. You have the send their context with each message. You would need an implementation that is designed to work with your API access point that modifies your prompt from there. I don't know if this code could be modified to do that and turned into a library. I know it would be a fair bit of work to turn script.py into a library and then a wrapper around that library.

KamiaoChan commented 1 year ago

I hope to add support for the API, mainly to include support for RisuAI. I am more accustomed to using RisuAI by connecting to the web UI through the API. If possible, I would appreciate the support. Thank you