search

Kim2091 / PBRify_Remix

My custom (ethical) set of AI models to upscale textures and generate PBR maps
Creative Commons Zero v1.0 Universal
44 stars 2 forks source link

Delighting model #1

Open goldenbait opened 3 weeks ago

goldenbait commented 3 weeks ago

Training a model to remove lighting information (highlights and shadows) from a picture is very useful for generating diffuse maps from real world pictures.

Never trained a neural network before, but I could help generating training data from CC0 sources.

(Love your work btw, exactly what is missing in the CG AI space, open source ethical models)

Kim2091 commented 3 weeks ago

Hi! Thank you for your interest and support🙂

I did actually attempt a model exactly for this task, and co-authored a Blender script to render baked textures from plain PBR textures. If you're interested, you can try that here.

Unfortunately, the model did not work out well. This level of processing really requires diffusion, or something like a style transfer model. I don't have the ability to train either of these ethically, so I haven't moved forward on this front. I still have the dataset for it however, so I may try again at some point.

If you want to mess with the model I trained for this purpose, you can get it from the RTX Remix Discord server, at this message