search

NVlabs / SPADE

Semantic Image Synthesis with SPADE
https://nvlabs.github.io/SPADE/
Other
7.6k stars 985 forks source link

3D Application #33

Open ryukra opened 5 years ago

ryukra commented 5 years ago

What would prevent this to be used as a 3d renderer where material colors match the physical materials? Except the high cost of rendering it in realtime.

taesungp commented 5 years ago

I don't have expertise in 3D, but I think the memory cost will be prohibitively high? To go from 2D to 3D in a naive way, the memory cost increases by the resolution in depth dimension, which is in order of hundreds.

ArashHosseini commented 5 years ago

@ryukra, we used maya with assets which are assigned with flat-shaders, rendered the viewport img via hardware renderer and used pix2pix to create the "final" textured image, far away from realtime..... in 3D you had to know more about the light sources in the scene, not just their world-space position but also the type and properties. I would at least try it, as a light type we could select Directional Light.