search

WeiChengTseng / Pytorch-PCGrad

Pytorch reimplementation for "Gradient Surgery for Multi-Task Learning"
BSD 3-Clause "New" or "Revised" License
302 stars 42 forks source link

support for amp? #15

Open HanGuangXin opened 2 years ago

HanGuangXin commented 2 years ago

Hi, thanks for your work!

I'm wondering whether this repository supports amp? or how can I do it?

anzeyimana commented 2 years ago

I have forked and implemented the idea here: https://github.com/anzeyimana/Pytorch-PCGrad-GradVac-AMP-GradAccum

HanGuangXin commented 2 years ago

Nice work! Really appreciate it!

---Original--- From: "Antoine @.> Date: Sun, Jun 19, 2022 16:37 PM To: @.>; Cc: "Han @.**@.>; Subject: Re: [WeiChengTseng/Pytorch-PCGrad] support for amp? (Issue #15)

I have forked and implemented the idea here: https://github.com/anzeyimana/Pytorch-PCGrad-GradVac-AMP-GradAccum

— Reply to this email directly, view it on GitHub, or unsubscribe. You are receiving this because you authored the thread.Message ID: @.***>