I ran the code according to the "Scripts" of DFQ.
Teacher - wrn_40_2, Student - wrn_16_1, dataset - CIFAR10
But the result is too much outstanding. The top1 accuracy in testset is more than 92%, which is even better than the result of cmi in the paper. I'm wondering if this is a coincidence or there are something wrong in the code?
I ran the code according to the "Scripts" of DFQ. Teacher - wrn_40_2, Student - wrn_16_1, dataset - CIFAR10 But the result is too much outstanding. The top1 accuracy in testset is more than 92%, which is even better than the result of cmi in the paper. I'm wondering if this is a coincidence or there are something wrong in the code?
Thx!