Closed jordane95 closed 2 years ago
@jordane95 how are you moving the data to GPU. Did you move data to GPU? train_dataset.to(device)
I don't see torch in that code , and that is the only way i know to use GPU
My bad, cuda was not enabled and its seems BeIR uses it automatically if available
[2022-06-06 10:29:03] INFO [beir.generation.models.auto_model.init:16] Use pytorch device: cuda
Now back to your multi-Gpu question :)
Hi @jordane95 and @ahadda5, sadly the code present in the repository uses Sentence-Transformers
as a framework where multi-GPU training is yet not available.
You can have a look at Tevatron in case you are interested in multi-GPU training.
Kind Regards, Nandan Thakur
Thanks! I will check it out.
jordane95
Hi @jordane95, could you solve this issue? I am also running dense models on MSMARCO but it exceeds memory during encoding corpus.
Hello,
I'm trying to use your code to train a bi-encoder on msmarco, but it seems that using a comparable batch size exceeds my GPU memory. Does your code support multi-gpu training?