search

NVlabs / nvdiffmodeling

Differentiable rasterization applied to 3D model simplification tasks
Other
456 stars 30 forks source link

how to use the result in blender #22

Open Lucklycat opened 1 year ago

Lucklycat commented 1 year ago

First of all, thank you very much for your results. I have learned all your projects ：nvdiffmodel,nvdiffec,nvdiffrecmc. in the project nvdiffec,nvdiffrecmc both provide python code to import the results into blender.

can you tell me this project result how to import into blender , i have tried many times, but there is a big gap between the pictures rendered in the training.

Can you provide an import code?

JHnvidia commented 1 year ago

Hi @Lucklycat,

Thanks for taking an interest in the code. We've been using mostly the same shading/material model for all three projects, so I think the script in nvdiffrecmc (https://github.com/NVlabs/nvdiffrecmc/blob/main/blender/blender.py) should be a good starting point. It may be that some intricacies, e.g. with normal mapping, have changed between the projects.

Unfortunately it's hard to get a complete match between our renderer and Blender. Blender is using path tracing and global illumination, which in combination with many other differing details makes it hard to match completely.

Lucklycat commented 1 year ago

Hi @Lucklycat,

Thanks for taking an interest in the code. We've been using mostly the same shading/material model for all three projects, so I think the script in nvdiffrecmc (https://github.com/NVlabs/nvdiffrecmc/blob/main/blender/blender.py) should be a good starting point. It may be that some intricacies, e.g. with normal mapping, have changed between the projects.

Unfortunately it's hard to get a complete match between our renderer and Blender. Blender is using path tracing and global illumination, which in combination with many other differing details makes it hard to match completely.

Thank you for your reply @JHnvidia . (1)Compared with nvdifec, the nvdiffrecmc project has more noise in the map of nvdifmodel. Is it because of the use of mipmap? Can I turn off using mipmaps in the nvdifmodel?when i import to blender ,like this: image

(2) How is it difficult to re-effect in commercial software, such as blender?Can you give some suggestions on which software is better for fine-tuning the low model after the model is simplified using nvdiffmodel? Because for the practical application, the relevant art students will make some adjustments after the simplification, so that they can really apply it