hustvl / MapTR

[ICLR'23 Spotlight & IJCV'24] MapTR: Structured Modeling and Learning for Online Vectorized HD Map Construction
MIT License
1.08k stars 163 forks source link

The experimental reproduction has a large variance. #142

Open xlHuang0719 opened 9 months ago

xlHuang0719 commented 9 months ago

Hi, dear author. Recently I've been working on a MapTRv1 reproduction. I experimented on 4 GPUs and with a batch size of 4 per GPU. I found that the jitter range of the reproduced mAP sometimes exceeds one point, e.g. from 49.9 to 51.2. I guess this is not normal. Is there any solution for this?