jcus0006 / mtdcovabm

Distributed Covid 19 Agent Based Model modelled on Maltese data.
0 stars 0 forks source link

Ray (or Dask on Ray) as a potential (alternative) framework #18

Closed jcus0006 closed 6 months ago

jcus0006 commented 11 months ago

https://www.anyscale.com/blog/analyzing-memory-management-and-performance-in-dask-on-ray

image

Dask on Ray uses a shared memory object store in the scheduler, the absence of which likely causes excessive overhead in Dask.

In this regard, Ray or Dask on Ray, may be considered, shortly.

jcus0006 commented 6 months ago

This was eventually not opted for, but Dask Strategy 2 replicates the same idea