HajimeTaira / InLoc_dataset

Other
68 stars 13 forks source link

Individual poses of reference database images and view synthesis #8

Open Shubodh opened 2 years ago

Shubodh commented 2 years ago

I am looking for individual poses of reference database images.

I went through the Inloc dataset, it looks like the pose for every reference database image has not been provided. Instead, we have a .mat 3D scan associated with every ref image, using which we can apply P3P between 2D-3D pair and obtain the desired pose as a closed form solution.

However, the pose obtained this way seems to have a slight offset.

The way I verified this is by: First using the 3D scan and our obtained pose (through p3p), I synthesized an image at that pose. Now since we already have our original image, I can compare the synthesized image and original image. Here are the examples.

So even this slight offset could result in more than 25% of the original image not visible in synthsized image.

  1. Is such offset considered within tolerable limit?
  2. Could you provide actual ground truth poses for reference images so that this offset will be avoided?
lahavlipson commented 2 years ago

@Shubodh Did you end up finding the ground truth camera poses anywhere? It seems that all the Inloc data is available except for the poses of the database/reference images. If not, did you end up using the poses solved from P3P? Thanks!

Shubodh commented 2 years ago

Yeah it seems like poses are not available. How unfortunate, would've been a complete dataset otherwise!

Yes, i ended up using poses from p3p, but as I shared in "verified" part of the original message, they don't seem extremely accurate.