search

Mephisto405 / Learning-Loss-for-Active-Learning

Reproducing experimental results of LL4AL [Yoo et al. 2019 CVPR]
215 stars 50 forks source link

How to reproduce the results? #15

Open Lee-daeho opened 2 years ago

Lee-daeho commented 2 years ago

Hello, Mephisto.

Thank you for the great paper and code.

I'm trying to reproduce the result of the paper.

I've seen that the results of others get overwhelmed by LL4AL.

However, I cannot reproduce the result that is really close to 90 at 10K data.

Also, the random result shows an 85% accuracy average.

Is there anything I'm missing?

Your figure from the paper shows that random has more than 85% accuracy, but, your reproduced result shows much less than 85%.

Is there any difference or explanation like you changed your torch version(c.f. I'm using torch version 1.5 and 1.9)?

Thanks.

Best, DaeHo Lee