parallel python tools to consider

ucberkeley / bce

Berkeley Common Environment provides a common Linux computational environment for classwork and research.

Apache License 2.0

13 stars 6 forks source link

parallel python tools to consider #70

Open paciorek opened 9 years ago

paciorek commented 9 years ago

might consider joblib for shared memory and ipython parallel tools for distributed. Currently we have multiprocessing (which comes installed by default) and pp installed for shared memory and pp for distributed.

davclark commented 9 years ago

Check out dask?

And certainly PySpark! (the full spark stack is installable with conda)