AlexanderDzhoganov / ComfyTextures

Unreal Engine ⚔️ ComfyUI - Automatic texturing using generative diffusion models
MIT License
549 stars 65 forks source link

Multiple view projections #5

Open MNeMoNiCuZ opened 10 months ago

MNeMoNiCuZ commented 10 months ago

This project looks promising, great job!

What are the plans for handling projections from multiple angles and texture blending?

There are of course relevant use cases even from one perspective, but it does have limitations.

AlexanderDzhoganov commented 9 months ago

There are several promising directions like Paint3D. I plan to implement this and other methods in the plugin as soon as code and pretrained checkpoints are released. I am open to suggestions, let's use this thread to collect relevant papers and code.

MNeMoNiCuZ commented 9 months ago

As a reference, but I don't think the code is available: https://stableprojectorz.com/

AlexanderDzhoganov commented 9 months ago

As a reference, but I don't think the code is available: https://stableprojectorz.com/

As far as I can see this doesn't really do anything special, it allows you to stitch together multiple single projections by inpainting. This is already somewhat possible in the plugin with the Preserve Existing Texture Data checkbox. I'm more interested in full 3D texturing methods that account for mesh topology.

MaxTran96 commented 8 months ago

does this create a 2D UV texture based on a single input image?