search

DLR-RM / AugmentedAutoencoder

Official Code: Implicit 3D Orientation Learning for 6D Object Detection from RGB Images
MIT License
336 stars 97 forks source link

Symmetrical objects performance? #102

Closed AnnaMelk closed 2 years ago

AnnaMelk commented 2 years ago

Hi! First of all, thank you for the code and clear instructions on how to run it, the auto-encoder works pretty great on T-LESS models that I've tried. I wanted to ask if there are any ways I could make this model perform better with symmetrical models? It works okay with my own 3D model, but it struggles with determining the orientation/rotation sometimes (predicted rendered view doesn't match the cropped webcam input)

Screenshot from 2022-01-26 14-37-26

Any insights are appreciated. Thank you very much!

MartinSmeyer commented 2 years ago

For such colorful objects, it is crucial that you are defining vertex color for your object surface as well. You can use e.g. Blender to define vertex colors on your 3D model:

https://www.youtube.com/watch?v=8mNk6r_bwxI