search

haosulab / SAPIEN

SAPIEN Embodied AI Platform
https://sapien.ucsd.edu/
MIT License
413 stars 40 forks source link

About the render #43

Closed ChicyChen closed 3 years ago

ChicyChen commented 3 years ago

Is it possible to use the render in sapien as a differentiable render for back-propagation? i.e. use rendering in sapien as a component in a neural network model pipeline, and back-propagate losses to modules before the render. Thanks a lot!

fbxiang commented 3 years ago

There is currently no plan to support differentiable rendering in SAPIEN, since rendering hardware pipelines are not designed for differentiability. You probably will want to look at projects dedicated to do differentiable rendering.