facebookresearch / phosa

Perceiving 3D Human-Object Spatial Arrangements from a Single Image in the Wild
Other
177 stars 21 forks source link

Is there a way to optimize the object fitting much better? #36

Closed monacv closed 3 years ago

monacv commented 3 years ago

Hello Jason,

Is there a way I could improve the object matching and transformation optimization to the 2D instance segmentation mask from PointRed? For example, my object in the original image is obviously upward, but the fit/matched item is downward.

Thanks a lot for any tip.

in1

out1

jasonyzhang commented 3 years ago

I am a bit surprised that the object fit is flipped. What does the mask look like? My guess is that very little of the pan handle was detected by PointRend.