search

mit-gfx / diffmat

PyTorch-based differentiable material graph library for procedural material capture
Other
103 stars 14 forks source link

Will the substance type change due to optimization? #11

Open HospitableHost opened 3 weeks ago

HospitableHost commented 3 weeks ago

This is a valuable work. But I still have a question, if a certain material (such as metal or wood or fabric) is optimized, will the optimization result still maintain the characteristics of the metal or wood or fabric?

Polar1s commented 3 weeks ago

Hi there! Thanks for the great question.

Basically, the optimization algorithm doesn't have a sense of material type - it only sees the graph structure and translates the graph into a differentiable program. The material type labels are assigned by artists. As the loss function is based on VGG features, you can potentially optimize a wood material against a concrete image and get a concrete material instead. It essentially depends on the expressiveness of the graph.