what the effect about parameter：beta、beta_freeze and beta_min、gamma

deepinsight / insightface

State-of-the-art 2D and 3D Face Analysis Project

https://insightface.ai

23.16k stars 5.39k forks source link

what the effect about parameter：beta、beta_freeze and beta_min、gamma #487

Closed zjz19960805 closed 5 years ago

zjz19960805 commented 5 years ago

hello, in your code, I have seen several line codes like this: if mbatch<=args.beta_freeze: _beta = args.beta else: move = max(0, mbatch-args.beta_freeze) _beta = max(args.beta_min, args.betamath.pow(1+args.gammamove, -1.0*args.power)) os.environ['BETA'] = str(_beta) And I discover that the same parameter beta has also appear on Lsoftmax, but I don't know what their usage, Could you please help me solve this problem? thank you very much.

nttstar commented 5 years ago

Used by sphereface loss, not recommended now.