search

facebookresearch / vissl

VISSL is FAIR's library of extensible, modular and scalable components for SOTA Self-Supervised Learning with images.
https://vissl.ai
MIT License
3.24k stars 330 forks source link

Example of using ZeRO and LARC #561

Open crypdick opened 1 year ago

crypdick commented 1 year ago

📚 VISSL Documentation

The docs for ZeRO gives an example of using ZeRO + LARC. However, the example has use_larc: False, which is confusing.

This should either be set to use_larc: True, or a note should be added that LARC will be used even if set to False here.

Thanks!