MLSys'21 | Accordion: Adaptive Gradient Communication via Critical Learning Regime Identification

ganler / ResearchReading

General system research material (not limited to paper) reading notes.

GNU General Public License v3.0

20 stars 1 forks source link

MLSys'21 | Accordion: Adaptive Gradient Communication via Critical Learning Regime Identification #53

Closed ganler closed 3 years ago

ganler commented 3 years ago

https://arxiv.org/pdf/2010.16248.pdf Related to gradient compression via adaptively trading off the compression level (or per-iteration speedup) and accuracy.