kiddyboots216 / CommEfficient

PyTorch for benchmarking communication-efficient distributed SGD optimization algorithms
71 stars 20 forks source link

Variable velocity #6

Closed kyrie-23 closed 2 years ago

kyrie-23 commented 2 years ago

Is the velocity stand for momentum? Cuz there's no velocity in the paper.

If I set args.local_momentum = 0 mode = sketch, will the local_velocity always be none?

Could the authors provide more commands to reproduce the entire experiment in the paper?