Feature request: Texture entire models and scenes with depth to image

[luoting123321]

Describe the feature you'd like to see:

There is a feature "Texture entire models and scenes with depth to image" in the other plugin Dream Texture. Is there any possibility in the futher Ai-Render also add this kind of feature?

Additional information

No response

[benrugg]

I love what Dream Textures does, but I don't have any plans to make this happen in AI Render. I think it's a difficult problem to solve, actually. I'm certainly open to contributions if anyone wants to work on this!

[LeonardMeagher2]

Currently I'm doing something like this using texture painting with a stencil brush where the texture is the AI render. I align the camera to my view, render, then set the stencil texture to the render and paint on the model.

2 prs #133 and #134 should make it easier to iterate with the current process. It'd also be interesting to just make a brush that can be used instead of modifying the camera and rendering. It'd probably still need a button to tell the sd backend to generate a new image and set it as the brush texture. Texture painting with a brush seems like it'd have a lot more control and not need to make projection uvs.

Brushes could have their own settings also I imagine, or just using the main prompt(s).

If that sounds interesting I can spend some time doing research and maybe make a PR/POC.

Here is a really quick model I did with the current plugin without any changes.

[benrugg]

@LeonardMeagher2, this is an amazing idea! Yes, if you have the time to do it, I would really appreciate any work you want to do on this. This is a highly requested feature (through the other channels I have, like YouTube and BlenderMarket inquiries), and many people would use this!