MarekKowalski / LiveScan3D

LiveScan3D is a system designed for real time 3D reconstruction using multiple Azure Kinect or Kinect v2 depth sensors simultaneously at real time speed.
MIT License
749 stars 202 forks source link

Multiple Marker Calibration Problem #20

Closed Lecanyu closed 6 years ago

Lecanyu commented 6 years ago

Hi,

Recently, I have tried to calibrate three Kinect2 which were put around a small office, their position look like an equilateral triangle.

Obviously, It is impossible to use only one marker to calibration all of Kinect2. So I have to use 2 marker. But After added 2 calibration marker in LiveScanServer Setting, I cannot get correct calibration of three Kinect2.

I noticed that there are Orientation and Translation slots in Calibration Marker Setting. Dose it mean I should provide the transformation between different Maker?

BTW, If I use the default Orientation and Translation (i.e all of six slots are 0), the calibration process looks like ambiguous because two different marker simultaneously locate global coordinate origin.

Could you tell me what the standard procedure of multiple marker calibration is? I cannot find this information from manual.

MarekKowalski commented 6 years ago

Hi,

Yes, you should provide the transforms. The easiest way to do this is to attach two markers to the opposite sides of a rigid box. In such case one marker can be set to all zeros and the other to rotation (0, 180, 0), and translation (0, 0, thickness_of_the_box).

Once you get an initial calibration using this method you can click refine to get a better estimate. The refinement works best if you constrain the reconstructed volume to only the area of interest, you can do that using the bounds in the settings menu. Let me know if that helps.

Best regards,

Marek

Lecanyu commented 6 years ago

Thank you for your reply!

For calibration part, I had gotten that from your paper.

But as similar with your second paragraph saying, Kinect scanning point cloud seems existing larger intrinsic error. Right?

Because the drift became bigger in rigid box area after ICP refine. (The rigid box area stitches better after only initial calibration without ICP refine).

MarekKowalski commented 6 years ago

Hi,

I'm sorry but I do not understand your question fully? Are you saying the error is higher after the ICP refinement? That might happen for some scenes, as I suggested you might want to try to limit the bounding box. If that does not work I suggest you do the refinement when a more "complex" object is in the scene, for example a human. ICP might converge to a bad solution if only a few planes are present.

Marek

Lecanyu commented 6 years ago

Hi,

Yes, I talked about error increasing after ICP refinement.

But except local optima problem. What I want to ask is:

Is it possible that there is intrinsic error in Kinect scanning? (i.e Foreground is aligned good after initial calibration but background is aligned bad. After ICP refinement, background is aligned good but foreground is aligned bad)

MarekKowalski commented 6 years ago

Hi,

Yes that is also possible. One of the sources of such error is the Multipath Intereference.

Marek

Lecanyu commented 6 years ago

OK, I also got that interference from your paper.

Thanks for your reply!