search

BR-IDL / PaddleViT

:robot: PaddleViT: State-of-the-art Visual Transformer and MLP Models for PaddlePaddle 2.0+
https://github.com/BR-IDL/PaddleViT
Apache License 2.0
1.22k stars 318 forks source link

BEIT模型在paddle混合精度训练下 前向出现nan。 #178

Closed Lemonahahah closed 2 years ago

Lemonahahah commented 2 years ago

BEIT模型在paddle混合精度训练下 前向出现nan。

Lemonahahah commented 2 years ago

patch embeding阶段就已经存在nan了：

image
xperzy commented 2 years ago

Thanks for the issue, 我们已经收到您的反馈，希望您能够提供更多信息，例如输入数据，模型等，我们会尽快安排修复。

Lemonahahah commented 2 years ago

可以给个HI的账号吗？厂内用户，想咨询几个问题。 发件人: xperzy @.> 答复: BR-IDL/PaddleViT @.> 日期: 2022年3月23日 星期三 下午5:03 收件人: BR-IDL/PaddleViT @.> 抄送: "He,Feng(KG)" @.>, Author @.***> 主题: Re: [BR-IDL/PaddleViT] BEIT模型在paddle混合精度训练下 前向出现nan。 (Issue #178)

Thanks for the issue, 我们已经收到您的反馈，希望您能够提供更多信息，例如输入数据，模型等，我们会尽快安排修复。

— Reply to this email directly, view it on GitHubhttps://mailshield.baidu.com/check?q=DKevR5VwRS79Mt2FRvPbzqMk1mPi843sUTJhax0DjGORmLJONWd6FXRbFwvZjTd2mwkBzSmsm33rXQOL3fQ%2bVFfquB9qsCHT1o3cKg%3d%3d, or unsubscribehttps://mailshield.baidu.com/check?q=%2bzSpOAdQT9nnMUC3NcAHHlz9Qcw%2f7QStryi2OKRE7ngXinuoGU9VKbv86Scbi0fPfl6RnBytnWDE3Ul6Q3h9FoA22C5Z%2bf%2b129VJ2dwtytRNRTeEze0wtF5lIjKNI0JYTIqLaw%3d%3d. You are receiving this because you authored the thread.Message ID: @.***>

xperzy commented 2 years ago

我这更新了一版代码，请查看https://github.com/BR-IDL/PaddleViT/tree/develop/image_classification/BEiT

xperzy commented 2 years ago

好的！

zhuyu05

On Thu, Mar 24, 2022 at 1:49 PM Lemonahahah @.***> wrote:

可以给个HI的账号吗？厂内用户，想咨询几个问题。 发件人: xperzy @.> 答复: BR-IDL/PaddleViT @.> 日期: 2022年3月23日 星期三 下午5:03 收件人: BR-IDL/PaddleViT @.> 抄送: "He,Feng(KG)" @.>, Author @.***> 主题: Re: [BR-IDL/PaddleViT] BEIT模型在paddle混合精度训练下 前向出现nan。 (Issue #178)

Thanks for the issue, 我们已经收到您的反馈，希望您能够提供更多信息，例如输入数据，模型等，我们会尽快安排修复。

— Reply to this email directly, view it on GitHub< https://mailshield.baidu.com/check?q=DKevR5VwRS79Mt2FRvPbzqMk1mPi843sUTJhax0DjGORmLJONWd6FXRbFwvZjTd2mwkBzSmsm33rXQOL3fQ%2bVFfquB9qsCHT1o3cKg%3d%3d>, or unsubscribe< https://mailshield.baidu.com/check?q=%2bzSpOAdQT9nnMUC3NcAHHlz9Qcw%2f7QStryi2OKRE7ngXinuoGU9VKbv86Scbi0fPfl6RnBytnWDE3Ul6Q3h9FoA22C5Z%2bf%2b129VJ2dwtytRNRTeEze0wtF5lIjKNI0JYTIqLaw%3d%3d>.

You are receiving this because you authored the thread.Message ID: @.***>

— Reply to this email directly, view it on GitHub https://github.com/BR-IDL/PaddleViT/issues/178#issuecomment-1077242961, or unsubscribe https://github.com/notifications/unsubscribe-auth/AA73D6VDHFDVWYFBQTK3TTDVBP67TANCNFSM5RM2YI7Q . You are receiving this because you commented.Message ID: @.***>