search

Denys88 / rl_games

RL implementations
MIT License
820 stars 138 forks source link

rl_device in Network #206

Closed 1tac11 closed 1 year ago

1tac11 commented 1 year ago

Hi there, I am just wondering, in A2CBuilder in Network, which cuda device is actually used for the training and how would I hand down the sim_device respectively rl_device variables from env_creator: create_env_thunk in Isaacgmyenvs or alike into the Network class so I can put the tensors onto the right GPU for torchrun Multi-GPU training? Or is the right cuda-device set automatically? Kind regards

1tac11 commented 1 year ago

guess its done in A2Cagent.init()

1tac11 commented 1 year ago

Hi there Did you manage to train on multiple instances not only standalone on multiple gpus?