search

zju3dv / clean-pvnet

Code for "PVNet: Pixel-wise Voting Network for 6DoF Pose Estimation" CVPR 2019 oral
Apache License 2.0
402 stars 106 forks source link

Dataset Generation with Larger Aruco Markers #205

Closed spencervoiss closed 2 years ago

spencervoiss commented 2 years ago

Hi, I'm having trouble with the ObjectDatasetTools dataset generator. Specifically, I'm running into some issues with registering a large target. I'm trying to generate a dataset for a model plane with a wingspan of 2.1m, but it's not registering properly. I've scanned a small target with moderate success, but the bigger target seems to be confusing the algorithm. I've attached photos of a successful registration (the small plane) and of the unsuccessful registrations (the big plane). My hypothesis is that the problems are resulting from the Aruco markers being too small for the cameras to pick up at the distances required to get the whole target in the shot. What all would I need to change in the source code for it to work with larger Aruco markers (perhaps 8"x8" per marker)? Do you think that enlarging the Aruco markers would solve this issue? Successful Registration with a Small Target: miniCessnaMetrology Example from small target RGB inputs 2594

Unsuccessful Registration with the Large Target: bigCessnaZED Example from large target RGB inputs 881

pengsida commented 2 years ago

I did not use ObjectDatasetTools before. So I do not know how to revise the code. I think that enlarging the Aruco markers is a good idea.

KAOeric commented 2 years ago

@spencervoiss Sorry to asking you, Did you success bounding your custom Dataset, How did you make it?

spencervoiss commented 2 years ago

@KAOeric I've had some success, but I still haven't gotten it quite right. It looks like ObjectDatasetTools doesn't care what size your AR markers are, so you can print them whatever size you want. It computes the positions of the markers by finding their centers from their corners rather than by scanning the actual markers themselves. I increased the size of the markers to 180 mm rather than 60 mm and had much better results, but there was still some error in registration. I can see the clear outline of the target, but it didn't register quite right. Any thoughts on how to improve this? All data was captured using an Intel Realsense L515 with ObjectDatasetTools Sample Photo from Dataset 1 Registered Scene CessnaRSBigPCBack CessnaRSBigPCSide

KAOeric commented 2 years ago

Hi @spencervoiss: Maybe you can adjust the AR marker to be straight, I already did it, just like this 1 This is my register scene, I think it looks great. 1644346581814 But my question is, I still cannot have a correct Bounding box result. Can you show me your success result? 1644346198825 And this is my current result, it seems terrible.

kygotocv commented 5 months ago

@spencervoiss I encountered the same problem, have you solved it?