Closed jabirshabbir closed 1 year ago
Thank you so much!
We noticed something very interesting that even after this PR, the GPU utility rate is still very low. One CPU core is occupied most of the time while the GPU is almost idle. We think the reason is on the implementation of tokenization, padding, etc.
Inefficient use of GPU is because the current WMD algorithm computes one instance at a time, even though inputs are given in the batch format. So GPU remains idle until WMD finishes a batch of computation instance by instance.
This PR will allow moverscore_v2.py to run with GPU support.