search

tidyverse / multidplyr

A dplyr backend that partitions a data frame over multiple processes
https://multidplyr.tidyverse.org
Other
641 stars 75 forks source link

Consider making `qs` a suggested package #135

Closed michaelquinn32 closed 11 months ago

michaelquinn32 commented 2 years ago

qs comes with a lot of native dependencies that can be a bit of a challenge to manage (e.g. 5 libraries in this package and PCRE2 in stringfish).

Since the API is meant to mostly reproduce what base R provides with readRDS and saveRDS, is it possible to make qs a suggestion? You get faster serialization if have it, but you don't have to rely on it if you don't.

Thanks!

hadley commented 11 months ago

My recollection is that qs makes a really big difference here; so much so that there's much less benefit to using multidplyr without it. I think that means it's unlikely we'd move it to suggests.