search

griptape-ai / griptape

Modular Python framework for AI agents and workflows with chain-of-thought reasoning, tools, and memory.
https://www.griptape.ai
Apache License 2.0
1.95k stars 160 forks source link

Explore support for local StableDiffusion models #504

Open andrewfrench opened 9 months ago

andrewfrench commented 9 months ago

Is your feature request related to a problem? Please describe. Some organizations must use self-hosted or local model deployments. Some drivers might support self-hosted models through configuration of the API endpoint, but local models might require additional work.

Describe the solution you'd like Clearly defined and documented support for local and self-hosted models.

Describe alternatives you've considered n/a

Additional context n/a

mgcollie commented 9 months ago

Thanks @andrewfrench 🙏

collindutter commented 9 months ago

Is there a particular method of interacting with local models you're interested in? We're already looking into support for Text Generation Interface via #89 which should allow for local models.

mgcollie commented 9 months ago

@collindutter I was thinking of maybe creating a driver for this: https://github.com/AUTOMATIC1111/stable-diffusion-webui/wiki/API for interacting with stable-diffusion locally in particular.

mgcollie commented 9 months ago

@collindutter maybe I can just use griptapes RestApiClient to do what I need. I'll poke around at that this afternoon

mgcollie commented 9 months ago

yeah that works.

collindutter commented 9 months ago

@mgcollie the RestApiClient, or even a custom Tool, sounds like a suitable solution for now. But lets keep this issue open so we can continue evaluating a long term solution here.

Regarding the Driver, I'd like to avoid reliance on WebUI, feels a little off to me. What are some other options for getting SD running locally?