search

JieShibo / PETL-ViT

[ICCV 2023] Binary Adapters, [AAAI 2023] FacT, [Tech report] Convpass
MIT License
162 stars 7 forks source link

Question about the reported performance. #7

Closed luogen1996 closed 1 year ago

luogen1996 commented 1 year ago

I can not reproduce the reported performance in my machine. On 3090, i get average performance of 74.72 for convpass_attn. I also notice that the performance varies in different environments. For examlpe, the performance of cifar is 71.46 and 71.24 on 3090 and A100, respectively.

JieShibo commented 1 year ago

Hi, The reported results in the paper are produced on RTX 3090. I wonder what script you ran to reproduce the results.

I'm not sure if different GPUs produce different results. We reran the code on different machines with RTX 3090 and got the same results.

luogen1996 commented 1 year ago

Hi, The reported results in the paper are produced on RTX 3090. I wonder what script you ran to reproduce the results.

I'm not sure if different GPUs produce different results. We reran the code on different machines with RTX 3090 and got the same results.

Thanks，now I obtain the reported results.