Good day @GeorgeCazenavette I was reading this "Distillation by Matching Training Trajectories" paper and a more recent paper of yours, and looked into the both repos. I was wondering if by any chance you have stored the checkpoint of models that are Trained from scratch on the whole dataset? Like the Table 8 model checkpoints form the GLaD paper?
Thanks in advance.
Flora
Hi I too am wondering if you managed to store checkpoints which could be really helpful to kind of see if we could utilise for other downstream tasks ?
Regards
Tanmoy
Good day @GeorgeCazenavette I was reading this "Distillation by Matching Training Trajectories" paper and a more recent paper of yours, and looked into the both repos. I was wondering if by any chance you have stored the checkpoint of models that are Trained from scratch on the whole dataset? Like the Table 8 model checkpoints form the GLaD paper?
Thanks in advance. Flora