search

FlagOpen / FlagGems

FlagGems is an operator library for large language models implemented in Triton Language.
Apache License 2.0
342 stars 45 forks source link

在跑通『LLaVA单卡+gems』过程总遇到的cat除零bug #302

Open 0x45f opened 2 hours ago

0x45f commented 2 hours ago

Describe the bug

cat有除零错误 image |

iclementine commented 2 hours ago

发现了问题了。在 FlagGems 的 pointwise 系列算子的 tile size 计算逻辑中没有考虑到 tensor 的 size 为 0 的问题。 fixing