search

capreolus-ir / capreolus

A toolkit for end-to-end neural ad hoc retrieval
https://capreolus.ai
Apache License 2.0
95 stars 32 forks source link

What size of GPU is needed to run CEDR-KNRM #167

Closed Eileenluu closed 3 years ago

Eileenluu commented 3 years ago

I was running CEDR-KNRM (the data set is ROBUST04) with a 20G GPU, the program was forced to stop after the documentation was compiled, I want to know what size of GPU is required.

andrewyates commented 3 years ago

This depends on the batch size and size of the BERT model you're using. With the default base model, you should be able to run on a 20GB GPU with a small batch size (eg batch=2).