LucasAlegre / morl-baselines

Multi-Objective Reinforcement Learning algorithms implementations.
https://lucasalegre.github.io/morl-baselines
MIT License
271 stars 44 forks source link

Multi-core Training PGMORL #68

Closed arshad171 closed 12 months ago

arshad171 commented 1 year ago

Hi,

I would to know if the algorithms support multi-core CPU processing or GPUs.

Currently, I am running PGMORL and I observe that my the computation is not utilized to its full potential. Initially, I was on M1 architecture but then switched to a 24 core 64-bit Linux machine, but I still observe that not all of the cores are being used, in fact just one of the cores reaches 100% during the training phase.

image

Since PGMORL trains several agents simultaneously, shouldn't it be possible to train them in parallel (on different cores)?

I looked up the documentation here PGMORL and found the reference to device parameter. So does it mean that GPU is supported? Also is it possible to do multi-core training on CPUs using raylib? (I could not find any doc references to this)

Regards, Arshad