open-mmlab / mmsegmentation

OpenMMLab Semantic Segmentation Toolbox and Benchmark.

https://mmsegmentation.readthedocs.io/en/main/

Apache License 2.0

7.98k stars 2.57k forks source link

Label Smoothing Regularization #1657

Open lorinczszabolcs opened 2 years ago

lorinczszabolcs commented 2 years ago

Support label smoothing regularization

Motivation Label smoothing has been shown to boost performance in Inception-V2, as well as in Revisiting ResNets papers.

Related resources PyTorch Cross-Entropy Loss already supports it, by passing label_smoothing parameter between 0.0 and 1.0. The Cross-Entropy implementation in mmsegmentation could take additional kwargs and pass them forward to the pytorch functions.

MengzhangLI commented 2 years ago

Hi, it is a good suggestion. We would consider to add this feature in cross entropy loss.