RchalYang / Soft-Module

Code for "Multi-task Reinforcement Learning with Soft Modularization"
https://rchalyang.github.io/SoftModule
108 stars 19 forks source link

Heavy CPU Consumption #3

Closed NagisaZj closed 1 year ago

NagisaZj commented 2 years ago

Hi @RchalYang ! Thank you for providing the code!

I found that running the code consumes a lot of CPU resources. Running 2 MT10 experiments at the same time consumes all of my 80 CPU cores. Is this normal? Or is there any way to limit CPU use? Thank you!

RchalYang commented 2 years ago

Hi, running this code does require a lot of CPU resources, it will create a separate process for each task in MT benchmark. I'm not quite sure how to limit the CPU use without modifying the current code. Maye you could try to run it in docker and limit the CPU usage of the container? Or you could rewrite part of the multi-processing part.