search

WisonZ / GKD

Code for GKD
8 stars 0 forks source link

Question about training settings #6

Closed Leun9 closed 1 year ago

Leun9 commented 1 year ago

We note that training settings is different between this repo and paper. One is {margin=0.4, CosLr with nesterov, Vanilla GKD}, the other is {margin=0.5, StepLr, Adaptive GKD}. Which one could be used to reproduce the GKD result on Tab. 5?

WisonZ commented 1 year ago

The performance (CosFace(m=0.4) & CosLr) is marginally better than that of original setting (ArcFace(m=0.5) & StepLr).

WisonZ commented 1 year ago

You can directly use the code I have uploaded before.

Leun9 commented 1 year ago

You can directly use the code I have uploaded before.

So, should I directly use the vanilla GKD rather than adaptive GKD?

WisonZ commented 1 year ago

yes