NVlabs / FoundationPose

[CVPR 2024 Highlight] FoundationPose: Unified 6D Pose Estimation and Tracking of Novel Objects
https://nvlabs.github.io/FoundationPose/
Other
955 stars 99 forks source link

bad result with custom data #94

Closed eunseon02 closed 1 week ago

eunseon02 commented 2 weeks ago

I am testing with my custom data, but the tracking results are poor, as you can see below. Please take a look at the video after the 10-second mark.

Screencast from 04-29-2024 01_02_51 AM.webm

i attached my dataset folder https://drive.google.com/file/d/1bCer4uM1yyu9qPbB3Er2UBByZz7rNDs5/view?usp=sharing

I'm using the code from the comment https://github.com/NVlabs/FoundationPose/issues/44#issuecomment-2048141043 to generate data

cypacjy commented 2 weeks ago

me too .when i use the tracking style .the first frames goes well.but when time goes by.the pose goes wrong. 0 i think it may be caused by the model with little characters .the solution still have not be founded

wenbowen123 commented 2 weeks ago

can you send your debug_dir for further check? Similar to https://github.com/NVlabs/FoundationPose/issues/83#issuecomment-2079709973

eunseon02 commented 2 weeks ago

this is debug folder https://drive.google.com/file/d/1m3r68X6qD39excPoWWXjeba4Ly07EOGp/view?usp=drive_link

wenbowen123 commented 2 weeks ago

you did not allow permission

wenbowen123 commented 2 weeks ago

when you run FoundationPose, your model texture is not loaded. See vis_refiner.png

eunseon02 commented 2 weeks ago

when you run FoundationPose, your model texture is not loaded. See vis_refiner.png

Thank you for your response. I tried again with a different dataset(using the code from #44, mask the mesh file with bundlesdf) but it still didn't work properly.

https://github.com/NVlabs/FoundationPose/assets/108911413/ca654baf-4394-4379-bc1d-d7d56612b696

https://github.com/NVlabs/FoundationPose/assets/108911413/0e0d24b0-e419-49fd-875f-0b2028af203e

this is the debug folder https://drive.google.com/file/d/1TwUg1oR6axPi1LKSSnBmxu3RFNfMVKfo/view?usp=drive_link https://drive.google.com/drive/folders/1m1ya5ZLovTmB1o6oRxs7cXV6EHTyK5Ch?usp=drive_link

liuchangji commented 3 days ago

@eunseon02 Hi, did you solve your tracking problem and if you solved it how you did?