Closed carson-katri closed 1 year ago
Looks like you've accidentally pushed the packaged CoreML backend in https://github.com/carson-katri/dream-textures/pull/654/commits/47118a07267bdb8b20b20d3a09e1ad8f4be1bda4
Should be fixed now.
Basic image generation is working. Here's a list of features that need to be tested/updated:
I just tried to test this tool, I have "automatic1111" server running on 127.0.0.1:7860 (working via web-interface), but on the "Dream" panel in Blender I see only "Huggingface Diffusers" backend and no available models… (I'm on Debian Linux) Does this approch yet to implement or I've made some error configuring? Thank you in advance. I'm not hurry or so, I'm just interested in this feature.
This PR doesn’t add an Automatic1111 backend, it just makes it possible for one to be created in the future.
Contributions for new backends would be welcome once this is merged!
So you dont plan to use ckpt/safetensors files, but rather allow for other backend? Is there performance loss with those types? Or just too much refactoring? I've read a few posts & was curious.
I had dreamtexture installed on last pc but have yet to dive back in on new setup, im glad you're still progressing & its looking great, blender is by far my favorite app. It'd be nice to use our model files from automatic1111, but regardless Dreamtextures stands on its own without it. I am fine with the two being separate, its simple enough to jump back & forth between them with stuff. But you're showing such great & deeper integrations its very tempting!
I imagine blender official will get in on the ai stuff too, its all still fast moving but at some point you might get some official specialized blender api stuff to work with too. Im keeping an eye out for when they start talking more ai.
@macronomicus Diffusers added a new from_single_file
loader, which can load .ckpt
/safetensor
files. With that we may be able to easily support separate lookup directories for single-file models.
I'll take a crack at adding from_single_file
since I'm already handling related code in #703
Took a bit more than I thought to fix VAE tiling. It's a bit of a mess with how it's juggling the image between torch and numpy, but it's functional for now. I'll get that in better order soon since I have some changes planned for VAE tiling.
Outpainting sort of works, but the outpainted regions remain black. Seems to be caused by changes made to the inpaint pipeline. You can color a portion of an image then mark that area for inpainting, and it will still resemble that color after inpainting now.
Could the strength
value be incorrect, so it takes some of the black/previous image into account?
That was it!
Closes #604
The API is slightly different than it that issue. You can see an example of a backend in
diffusers_backend.py
, which is the default Dream Textures backend.A backend could be as simple as a single file Blender add-on, so I'm considering adding a folder to this repo to contain scripts for additional backends that would be maintained by different community members. This could contain backends for sources like Automatic1111, DreamStudio, InvokeAI, StableHorde, etc.