search

takuseno / d3rlpy

An offline deep reinforcement learning library
https://takuseno.github.io/d3rlpy
MIT License
1.29k stars 230 forks source link

How to use multi gpu? #104

Closed yuxudong20 closed 3 years ago

yuxudong20 commented 3 years ago

Hello, @takuseno ,i want to use multi gpu to train the model, but i don't know how to set the parameter. I found that “use_gpu” could be set as bool, int or d3rlpy.gpu.Device. Is this the parameter for choosing multi gpu?

takuseno commented 3 years ago

@yuxu1997 Sorry for the late response. Currently, there is no support for multiple GPUs. This is because, in the most of cases, we don't use a large dataset nor large neural network models in RL. If I had multiple GPUs, I'm inclining to run multiple experiments instead.

takuseno commented 3 years ago

Please feel free to reopen this if you have further discussions.