Closed merrymercy closed 3 years ago
If the batch size is larger than 65535, it will trigger a CUDA block size limitation. This PR fixes this issue by launching multiple kernels for batch size > 65535.
This PR also updates all int32 index to int64 to prevent potential integer overflow.
If the batch size is larger than 65535, it will trigger a CUDA block size limitation. This PR fixes this issue by launching multiple kernels for batch size > 65535.
This PR also updates all int32 index to int64 to prevent potential integer overflow.