search

sdtaylor / phenology_dataset_study

1 stars 1 forks source link

switch from MPI to dask #9

Closed sdtaylor closed 6 years ago

sdtaylor commented 7 years ago

Because MPI is impossible to debug

sdtaylor commented 7 years ago

next time I have MPI troubles it would probably be easier to switch to slurm arrays instead

sdtaylor commented 6 years ago

nah

sdtaylor commented 6 years ago

coming back around since a bunch of the new phenology stuff needs to work on the hipergator

simple example that should work for the most part here https://stackoverflow.com/questions/42550529/dask-how-would-i-parallelize-my-code-with-dask-delayed

sdtaylor commented 6 years ago

dask discussion for working on slurm/pbs https://github.com/dask/distributed/issues/1260

sdtaylor commented 6 years ago

nope, nm