carson-katri / dream-textures

Stable Diffusion built-in to Blender
GNU General Public License v3.0
7.82k stars 427 forks source link

Local models #531

Closed guzuligo closed 1 year ago

guzuligo commented 1 year ago

Instead of using 🤗's API, I'd like to use local models. Is there a way, or does that have to be developed?

carson-katri commented 1 year ago

The addon does generate locally, using the diffusers package (created by Hugging Face). DreamStudio is the only cloud option preset.

carson-katri commented 1 year ago

If you’re referring to using a diffusers-format model you trained locally, you can place the folder in C:\Users\YOURUSER\.cache\huggingface\diffusers

guzuligo commented 1 year ago

I pasted it there but it doesn't seem I can choose it .🫤

carson-katri commented 1 year ago

Are there any errors in Window > Toggle System Console?

Also ensure that the folder structure is correct, it should be one folder deep, with a model_index.json file at the top level:

guzuligo commented 1 year ago

I just have a ckpt. How can I construct a json for it?

carson-katri commented 1 year ago

Oh, then you need to use the “Import Checkpoint” button in the preferences :)

Here’s the instructions for that: https://github.com/carson-katri/dream-textures/blob/main/docs/SETUP.md#importing-checkpoints

The model would need to be in diffusers format if you wanted to just place it there.

guzuligo commented 1 year ago

No import button =/ image

carson-katri commented 1 year ago

Seems you have downloaded a DreamStudio-only version of the addon. You need to get one that supports local generation, such as the CUDA version: https://github.com/carson-katri/dream-textures/releases/tag/0.0.9