How to optimize GPU usage?

amazon-science / ReFinED

ReFinED is an efficient and accurate entity linking (EL) system.

Other

196 stars 40 forks source link

Open deepak-newzera opened 1 year ago

deepak-newzera commented 1 year ago

I am running the model on a batch of 500 articles and it takes around 10 to 15 GB of GPU memory. Is there a way to optimize the GPU usage?