search

GeorgeCazenavette / mtt-distillation

Official code for our CVPR '22 paper "Dataset Distillation by Matching Training Trajectories"
https://georgecazenavette.github.io/mtt-distillation/
Other
395 stars 55 forks source link

args.mom in buffer.py #9

Closed liuyugeng closed 2 years ago

liuyugeng commented 2 years ago

Hi, I found there is a momentum in teacher_optim named args.mom in buffer.py but I didn't find the value of it. Could you pls provide it? Many thanks

GeorgeCazenavette commented 2 years ago

Just fixed it.

I left the options to set momentum and l2 regularization for you, but we used values of 0 in all our experiments.

Initial tests seemed to perform worse with non-zero values, but I didn't spend a lot of time trying to make it work.

liuyugeng commented 2 years ago

Thx!