search

writer / fitbert

Use BERT to Fill in the Blanks
https://pypi.org/project/fitbert/
Apache License 2.0
82 stars 14 forks source link

The rank funtion takes over 1 min to execute #16

Closed vishalaksh closed 4 years ago

vishalaksh commented 4 years ago

I am trying to use this library for a real time prediction. But it is taking more than 1 min even on GPU to predict. Here is a colab link.

Here is a screenshot showing the execution time: image

What could be the possible reason for this latency? Is it pertaining to the library or BERT itself?

Thanks

sam-writer commented 4 years ago

that is strange, it didn't used to. I wonder if this has to do with framework choice? Also in that link, I see: image

sam-writer commented 4 years ago

Since I can't reproduce, I am closing this