DEHewitt / portunid_particle_tracking

Code for simulation and analysis of particle tracking experiments for Giant Mud Crab (Scylla serrata) and Blue Swimmer Crab (Portunus armatus)
0 stars 0 forks source link

Set appropriate chunk size for dask #19

Closed DEHewitt closed 3 years ago

DEHewitt commented 4 years ago

Currently using default setting of dask to control the chunksizes which may not be the most efficient (for time or memory). This can be controlled via the argument field_chunksize when the field is defined in FieldSet.from_netcdf(). See https://nbviewer.jupyter.org/github/OceanParcels/parcels/blob/master/parcels/examples/documentation_MPI.ipynb for a full explanation.