search

youngskkim / CRN

[ICCV'23] Official implementation of CRN: Camera Radar Net for Accurate, Robust, Efficient 3D Perception
MIT License
99 stars 15 forks source link

Failed to Achieve Expected Experimental Results #9

Open SunLuyue26 opened 5 months ago

SunLuyue26 commented 5 months ago

image Hello, I replicated the experiment following the experimental setup in your paper's appendix and your code, but did not achieve the results mentioned in your code comments. Is there any additional configuration, such as Test Time Augmentation (TTA)? Or what could be the reason for this discrepancy? Looking forward to your reply, thank you very much!

youngskkim commented 5 months ago

Hi, can you reproduce the reported number using the provided checkpoint? If you can reproduce results by checkpoint, the performance gap can be caused by the training randomness.

The performances reported in config files are obtained without TTA.

jaser-rayeh commented 4 months ago

@SunLuyue26 Hello, I encoutered some errors while trying to compile the CRN Checkpoint. I see that you came to measure its performance could you help me please solve this issue.

loserhou commented 1 month ago

image Hello, I replicated the experiment following the experimental setup in your paper's appendix and your code, but did not achieve the results mentioned in your code comments. Is there any additional configuration, such as Test Time Augmentation (TTA)? Or what could be the reason for this discrepancy? Looking forward to your reply, thank you very much!

have you solved the problem?i also can't reproduce the results