ShichenLiu / SoftRas

Project page of paper "Soft Rasterizer: A Differentiable Renderer for Image-based 3D Reasoning"
MIT License
1.24k stars 156 forks source link

The effect on training speed using softras #46

Closed FishWoWater closed 3 years ago

FishWoWater commented 4 years ago

Hi! Thanks for sharing your nice work! I am doing human mesh reconstruction task(with SMPL model). Before I use the mask to supervise our network(i.e. use soft rasterizer), 1 epoch finishes in about 10 mins, but after using softras... It becomes very slow(about 3h a epoch). I don't know whether this is a normal phenomenon. Does the rasterization generally affect the speed a lot?(In particular, I use 6890 vertices and 13776 faces). Thanks!

ShichenLiu commented 3 years ago

I think this is due to too many triangles and also large image size. My solution would be use less triangles / train in a hierarchical way to reduce computation.

ssjsusie commented 3 years ago

Hi! Thanks for sharing your nice work! I am doing human mesh reconstruction task(with SMPL model). Before I use the mask to supervise our network(i.e. use soft rasterizer), 1 epoch finishes in about 10 mins, but after using softras... It becomes very slow(about 3h a epoch). I don't know whether this is a normal phenomenon. Does the rasterization generally affect the speed a lot?(In particular, I use 6890 vertices and 13776 faces). Thanks!

Hello, I am also trying the same job. How do you get the non-square rendering result? I see that the SoftRasterizeFunction part makes image_size=256. thank you very much!