Support padding mask in lightseq kernel (draft tested with simple cases). The inputs will be unpadded before being fed into the kernel. Currently only support unpadded length to be a multiple of flash attn block size, will support all unpadded lengths in next update.
Support padding mask in lightseq kernel (draft tested with simple cases). The inputs will be unpadded before being fed into the kernel. Currently only support unpadded length to be a multiple of flash attn block size, will support all unpadded lengths in next update.