search

xgcm / aerobulk-python

A python wrapper for aerobulk (https://github.com/brodeau/aerobulk)
GNU General Public License v3.0
14 stars 4 forks source link

xarray_apply with dask='parallelized' is not parallelizing #25

Closed jbusecke closed 2 years ago

jbusecke commented 2 years ago

Running a test with #20 on the pangeo cloud deployment right now, and even though my machine has 4-8 cores, the cpu usage is hovering around ~100 (determined via top).

I wonder if this has to do with the fact that we havent released the GIL? Or is this a different issue?

jbusecke commented 2 years ago

See https://github.com/ocean-transport/scale-aware-air-sea/issues/28#issuecomment-1158349005 for some progress on this.

jbusecke commented 2 years ago

Closed via #34