Hilti-Research / hilti-slam-challenge-2022

51 stars 1 forks source link

Error submission #6

Closed hellovuong closed 2 years ago

hellovuong commented 2 years ago

Hello, thank you for organize this challenge. I run into error when trying to submit. After submit zip file and report. The score appears to have error as following: python: can't open file '/var/task/evaluation-2022/batch_evaluation.py': [Errno 2] No such file or directory My zip file includes:

Can you take a look at it if anything wrong? Thank you in advance

hemi86 commented 2 years ago

We are working on it, expect an update next week!

hellovuong commented 2 years ago

Thank you, looking forward to the update.

hilti-challenge commented 2 years ago

the automatic evaluation system should be functional right now.

IamPhytan commented 2 years ago

On the same topic, I tried to submit my results and I got the following error :

Traceback (most recent call last): File "/var/task/evaluation-2022/batch_evaluation.py", line 224, in evaluate_submission(submission_path, groundtruth_path) File "/var/task/evaluation-2022/batch_evaluation.py", line 87, in evaluate_submission ape_stats, dense_trajectory, traj_est_aligned, traj_ref = evaluate(est_file, ref_file,submission_path) File "/var/task/evaluation-2022/evaluation.py", line 240, in evaluate umeyama_parameters = traj_est_aligned.align(traj_ref_sync, correct_scale=False, correct_only_scale=False) File "/var/task/evo/core/trajectory.py", line 203, in align r_a, t_a, s = geometry.umeyama_alignment(self.positions_xyz.T, File "/var/task/evo/core/geometry.py", line 70, in umeyama_alignment raise GeometryException("Degenerate covariance rank, " evo.core.geometry.GeometryException: Degenerate covariance rank, Umeyama alignment is not possible

Is this an error on the server ? Or is our data not coherent with what is accepted by the server ?

hellovuong commented 2 years ago

Hi @IamPhytan I tried to submit this afternoon, everything works well. I think you should check the file formats. Be sure it follows the submit instructions

IamPhytan commented 2 years ago

Yes, I found out it's not an error related to the website, but most probably an error in my trajectories. Thanks for the input @hellovuong