search

isl-org / TanksAndTemples

Toolbox for the TanksAndTemples benchmark website
Other
82 stars 23 forks source link

Cannot get the same results in Ignatius #29

Open hagianga21 opened 3 years ago

hagianga21 commented 3 years ago

Hi, I run the same setting in your script get_colmap_reconstruction.sh (https://raw.githubusercontent.com/IntelVCL/TanksAndTemples/master/python_toolbox/get_colmap_reconstruction.sh), but I cannot get the same results with your files. The F-score is only 71%, but when I evaluate using your file, the F-score is 80%. Do I have to change any hyperparameters? Could you please help me? Thanks so much.

arknapit commented 3 years ago

Hello,

I could see two reason for that:

  1. Check your input images, make sure you did the resize exactly like explained in our tutorial (#1 https://www.tanksandtemples.org/tutorial/), also make sure, that the default focal length was written to the EXIF
  2. Our reconstructions were made more than 3 years ago, maybe some default parameters have changed in the meanwhile in COLMAP, try to checkout a COLMAP 3.5 or 3.6 version and see if something changes.

greetings Arno

On Sun, Nov 22, 2020 at 7:26 PM hagianga21 notifications@github.com wrote:

Hi, I run the same setting in your script get_colmap_reconstruction.sh ( https://raw.githubusercontent.com/IntelVCL/TanksAndTemples/master/python_toolbox/get_colmap_reconstruction.sh), but I cannot get the same results with your files. The F-score is only 71%, but when I evaluate using your file, the F-score is 80%. Could you please help me? Thanks so much.

— You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub https://github.com/intel-isl/TanksAndTemples/issues/29, or unsubscribe https://github.com/notifications/unsubscribe-auth/ADEGKEUBO7CN7VP6E4WMNGDSRFJTTANCNFSM4T6UO5PA .

hagianga21 commented 3 years ago

Thanks for your help.

  1. Hi, I only use the image set from your download, not the video. For the image set, unzip the package and go to step 2. Did I miss something?
arknapit commented 3 years ago

if you use our prepared image set, then this is probably not the cause.

Try to see if an older COLMAP version solves the problem like suggested before.

greetings Arno

On Tue, Nov 24, 2020 at 1:25 PM hagianga21 notifications@github.com wrote:

  1. Hi, I only use the image set from your download, not the video. For the image set, unzip the package and go to step 2. Do I miss something?

— You are receiving this because you commented. Reply to this email directly, view it on GitHub https://github.com/intel-isl/TanksAndTemples/issues/29#issuecomment-732942020, or unsubscribe https://github.com/notifications/unsubscribe-auth/ADEGKEV4XHPYNK5Z2CVT6A3SROQ4JANCNFSM4T6UO5PA .