vlomonaco / ar1-pytorch

AR1* with Latent Replay, implemented in PyTorch
https://arxiv.org/abs/1912.01100
Other
31 stars 9 forks source link

Reproducing results for AR1* with 500 latent replay size #6

Open WeiWeic6222848 opened 5 months ago

WeiWeic6222848 commented 5 months ago

Dear Mr. Lomonaco,

Thank you for making the code of AR1* publicly available and re-implement it in pytorch. I'm trying to recreate the result of Figure 4 of the paper https://arxiv.org/pdf/1912.01100. The setting is NICv2-391 with replay buffer size 500.

I have kept all the parameter of params.cfg the same and only changed rm_rz from 1500 to 500, the result is an accuracy of 63.62%, specifically: Accuracy: 0.6362827923521566.

This is far from the reported ~70% as shown below.

image

Is there some parameter I should change to recreate the results from the paper?

Thank you in advance,

Best regards, Wei