PaddlePaddle / PaddleFleetX

飞桨大模型开发套件,提供大语言模型、跨模态大模型、生物计算大模型等领域的全流程开发工具链。
Apache License 2.0
440 stars 162 forks source link

Call paddle.incubate.nn.functional.fused_gate_attention and set use_flash_attn to true. #1087

Open Xreki opened 1 year ago

Xreki commented 1 year ago

rt

CLAassistant commented 1 month ago

CLA assistant check
Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.
You have signed the CLA already but the status is still pending? Let us recheck it.