1ytic / warp-rnnt

CUDA-Warp RNN-Transducer
MIT License
211 stars 41 forks source link

WARNING: sample 0 [42, 26] has a forward/backward mismatch -52.543503 / 0.000000 #19

Open songtaoshi opened 3 years ago

songtaoshi commented 3 years ago

image image

what does the mismatch mean?

my_env. python=3.7.0. torch=1.6.0.
cuda=10.2.

songtaoshi commented 3 years ago

@1ytic @TeaPoly

1ytic commented 3 years ago

Something is wrong with compiled kernels. Basically, this means the wrong computation of the loss.

MrDoghead commented 2 years ago

same issue, does anyone know how to solve it?