exponential smoothed weighting of data

google-research / bert

TensorFlow code and pre-trained models for BERT

https://arxiv.org/abs/1810.04805

Apache License 2.0

38.23k stars 9.62k forks source link

exponential smoothed weighting of data #1306

Open StephennFernandes opened 2 years ago

StephennFernandes commented 2 years ago

hey there, by any chance how could i find the implementation of "exponential smoothed weighting of the data", i need to implement this in my mT5 pre-training. couldn't find it in the codebase.