search

nmoehrle / mvs-texturing

Algorithm to texture 3D reconstructions from multi-view stereo images
Other
933 stars 328 forks source link

Ghosting effect on some datasets #70

Closed pierotofy closed 7 years ago

pierotofy commented 7 years ago

While processing this dataset (https://github.com/pierotofy/drone-datasets/tree/master/sheffield_park) I get a strange ghosting effect:

This might be related to the photo consistency check?

image

nmoehrle commented 7 years ago

Yes this is related to the photo consistency check, which was designed to prevent exactly this and... failed. The reason that the thing (btw. what is this, a golf cart pulling a boat?) is chosen to texture multiple faces is that it has a much higher gradient magnitude than the road.

It would be interesting to see why the photo consistency check failed in this case. My assumption is that that there was no consensus between the images on the true albedo.

Can you tell me something about the drones trajectory? Did the drone fly orthogonal to the road? If multiple images show the "thing" at one location this would skew the true albedo estimation... How many images show this part of the scene?

pierotofy commented 7 years ago

Hi @nmoehrle thanks for the reply! I think it's a golf cart carrying a canoe on wheels.

Yes the drone flew orthogonal to the road. There are 5 images in the sequence that depict the object:

  1. image

  2. image

  3. image

  4. image

  5. image

From DJI_0191 to DJI_0195 included.

You can see the drone flying forward, while the cart is moving left to right.

pierotofy commented 7 years ago

Actually, I have to apologize, I was under the assumption that the consistency check would be turned ON by default, but that was not the case.

Turning on "gauss_clamping" for --outlier_removal worked quite well!

image