search

alfredgu001324 / MapUncertaintyPrediction

[CVPR 2024 Award Candidate] Producing and Leveraging Online Map Uncertainty in Trajectory Prediction
https://arxiv.org/abs/2403.16439
Apache License 2.0
135 stars 10 forks source link

Why mAP degradation for StreamMapNet? #3

Closed xiaolul2 closed 2 months ago

xiaolul2 commented 3 months ago

Thanks for your interesting work! I'd like to know why the learning of uncertainty has such a bad influence on mAP evaluation based on the StreamMapNet framework. Is there any strategy for improvement? Thanks for your response.

alfredgu001324 commented 3 months ago

Thank you for your interest in our work! That is actually one of the unresolved problems in our work. One of the possibilities is that I did not do a proper hyperparameter sweep (which is actually indeed the case). Another reason I was thinking is this uncertainty learning results in less stable training behaviour (as seen in the suppl of the paper), it is hard to stabilize the gradients during training. This might have a greater influence on a temporal aggregation setting.

For now I do not really have a strategy for improvement since the main focus of the work is just investigating the relative performance improvements. But this can definitely be an exciting future research direction! (like using unc itself as additional feedback correcting signal during training process)

xiaolul2 commented 2 months ago

Thanks for your answer!