Closed wtomin closed 2 months ago
Fix the bug that DiT Attention cannot handle mask which is not None. Using ops.select instead of masked_fill to fill mask with -inf value.
Attention
ops.select
masked_fill
-inf
Fix the bug that DiT
Attentioncannot handle mask which is not None. Usingops.selectinstead ofmasked_fillto fill mask with-infvalue.