Does it support multi threading and multi processing

AndriyMulyar / semantic-text-similarity

an easy-to-use interface to fine-tuned BERT models for computing semantic similarity in clinical and web text. that's it.

MIT License

215 stars 51 forks source link

Does it support multi threading and multi processing #19

Open Dineshkumar-Ponnusamy opened 3 years ago

Dineshkumar-Ponnusamy commented 3 years ago

I tried to run this model against a data set containing about 40k items. With current rate, it may take more than 200 days. Is there any support available for multi threading/multi processing, the goal is to reduce the time taken for each prediction.

I tried few basic things and CUDA ran out of memory in between. Any help is much appreciated.