minwoo0611 / HeLiPR-Pointcloud-Toolbox

The HeLiPR Pointcloud Toolbox is a sophisticated software suite tailored for processing and analyzing the HeLiPR (Heterogeneous LiDAR Place Recognition) dataset.
30 stars 1 forks source link

Question about evaluation procedure #3

Closed jac99 closed 7 months ago

jac99 commented 7 months ago

Hi, I've got a question about the evaluation procedure described here: https://sites.google.com/view/heliprdataset/place-recognition I'd like to use the same evaluation protocol to test my method. I want to ask about the sequence names in Table 1 AUC Score. Does 'Roundabout01-03' means that Roundabout01 was a query traversal and Roundabout03 was a target/database traversal. Or was it the opposite? Does it also mean that Roundabout02 was not used in the evaluation?

minwoo0611 commented 7 months ago

Dear @jac99,

Thank you for reaching out with your query.

In the context of the evaluation procedure you're referring to, 'Roundabout01-03' signifies that Roundabout01 served as the query, while Roundabout03 was employed as the target or database for comparison. Indeed, as you surmised, Roundabout02 was not incorporated into our evaluation experiments.

I hope this clarifies your question. Should you have any further inquiries or require additional clarification, please do not hesitate to ask.

Best regards,

Minwoo

jac99 commented 7 months ago

Everything is clear now. Thank you for a quick answer.