search

kishwarshafin / pepper

PEPPER-Margin-DeepVariant
MIT License
245 stars 42 forks source link

PEPPER-Margin-DeepVariant takes more cores than limit #208

Open martabaragli opened 4 months ago

martabaragli commented 4 months ago

Hi, I am running PEPPER-Margin-DeepVariant via singularity, however I noticed that even when setting a 10 threads limit (-t 10), it takes up to 200 cores. At first I thought it was an issue with singularity, but setting a thread limit on singularity exec doesn't help either (in fact, the default for --vm-cpu string is 1). Do you have any idea why this may happen?

Thank you Marta

minaminii commented 3 months ago

Hi, you issue may be caused by PyTorch CPU limit hasn't been configured, making it use all of the available cores. Try setting environment variable OMP_NUM_THREADS=10 or use torch.set_num_threads()

More information https://discuss.pytorch.org/t/cpu-usage-extremely-high/52172