Closed zhangxuan1918 closed 5 years ago
refactor training script
[x] make script module and easy to change [x] remove landmarks header, get landmarks from shape and pose [] do not normalize landmarks when preparing training data [x] make the loss function configurable, e.g. tex loss can be l1 instead of l2
try to write the rendering using tensorflow. Currently the rendering is done using numpy. We need to check if this can be done using tensor, e.g. shape_param is a tensor instead of numpy array. Besides, we need to do it in batch
looks like it's a bit hard to render directly in tensorflow. In https://github.com/tensorflow/graphics/blob/master/tensorflow_graphics/rendering/differentiable_renderer/rasterizer.py, it can render vertices and triangles. But without texture.
Maybe check https://github.com/tranluan/Nonlinear_Face_3DMM/blob/master/rendering_ops.py to see how they do rendering
looks complicated, will turn tensor to numpy and render sequentially
looks complicated, will turn tensor to numpy and render sequentially
cannot do this. If we do this, tensorflow is not able to compute the gradient. Everything has to be done using tensor
make it more module