search

tidyverse / multidplyr

A dplyr backend that partitions a data frame over multiple processes
https://multidplyr.tidyverse.org
Other
641 stars 75 forks source link

feature request: support asynchronous evaluation (e.g. with job schedulers) #64

Closed julou closed 5 years ago

julou commented 6 years ago

it would be awesome if the cluster could be specified so as to feed jobs to a scheduler. the package future might be a starting point? https://cran.r-project.org/web/packages/future/index.html

hadley commented 5 years ago

This is out of scope for multidplyr, sorry.