dask / distributed

A distributed task scheduler for Dask
https://distributed.dask.org
BSD 3-Clause "New" or "Revised" License
1.58k stars 719 forks source link

Remove OMP_NUM_THREADS if set to empty #8917

Open mrocklin opened 3 weeks ago

mrocklin commented 3 weeks ago

Generally though, sometimes our use of OMP_NUM_THREADS makes other systems sad. It's unfortunately somewhat difficult to turn off. A common approach is that people set OMP_NUM_THREADS="" but this doesn't properly unset things.

I'm curious if an approach like this would be helpful.

There might be a cleaner way to do this, and this might be a bad idea. Please feel free to reject. It was just easy to put this up as a PR.

@ntabris would something like this make your life easier? @fjetter is this not dumb?

ntabris commented 3 weeks ago

would something like this make your life easier?

Not anytime soon but seems like a positive change to me.

github-actions[bot] commented 3 weeks ago

Unit Test Results

_See test report for an extended history of previous test failures. This is useful for diagnosing flaky tests._

    25 files  ± 0      25 suites  ±0   10h 21m 20s ⏱️ + 7m 36s  4 129 tests + 1   4 015 ✅ +1    110 💤 ±0   4 ❌ ± 0  47 680 runs  +12  45 574 ✅ +1  2 088 💤 ±0  18 ❌ +11 

For more details on these failures, see this check.

Results for commit e8d9b815. ± Comparison against base commit 29530909.

fjetter commented 3 weeks ago

No objections. It appears to not be working, though. The test is failing (linter is also off)