search

Maartendrinhuyzen / ai4mi_project

MIT License
0 stars 0 forks source link

Find a better optimizer than Adam #2

Closed Maartendrinhuyzen closed 1 month ago

richtervanemmerik commented 1 month ago

Now trying AdamW

richtervanemmerik commented 1 month ago

Paper about the AdamW AdamW: A Better Optimizer for Deep Learning Authors: Ilya Loshchilov and Frank Hutter Link: arXiv:1711.05101

richtervanemmerik commented 1 month ago

Example Application in Medical Image Segmentation AdamW: Title: MedSegDiff: Medical Image Segmentation with Diffusion Probabilistic Model Link: arXiv:1804.03999

richtervanemmerik commented 1 month ago

It improved the DSC from 0.833 ---> 0.838