GzyAftermath / CAT-KD

CVPR 2023, Class Attention Transfer Based Knowledge Distillation
32 stars 3 forks source link

Regarding the Reproducibility of Results #7

Open xhdr0618 opened 1 month ago

xhdr0618 commented 1 month ago

Thank you very much for your insightful work, but I found that the results of res324_res84 during the reproduction process do not meet the benchmarks in the paper. Why is that? The result on CIFair-100 is 75.01

GzyAftermath commented 1 month ago

Sorry for the late response. Could you check if the hyperparameters were changed and whether the CIFAR-100 experiments were run on a single GPU? Also, is this result averaged over five runs?