utdemir / distributed-dataset

A distributed data processing framework in Haskell.
BSD 3-Clause "New" or "Revised" License
114 stars 5 forks source link

Graph-based execution #11

Open utdemir opened 5 years ago

utdemir commented 5 years ago

Currently we wait for a stage to finish before starting another one. It would be nicer to have a proper dependency graph where the nodes are tasks, so we can schedule things more efficiently.