Feature Request - Parallel pairwise_* functions

juliasilge / widyr

Widen, process, and re-tidy a dataset

http://juliasilge.github.io/widyr/

Other

327 stars 29 forks source link

Feature Request - Parallel pairwise_* functions #33

Closed storopoli closed 1 year ago

storopoli commented 3 years ago

Could we have a parallel implementation of the pairwise_* functions?

This could be done with furrr, I guess...

juliasilge commented 1 year ago

Thank you so much for your patience on this! 🙌

The operations that this package supports are all matrix-like, with a pattern of "tidy ➡️ wide ➡️ tidy". This isn't something that can be done in parallel directly as the entire matrix needs to be in memory for the transformation. Let us know if you have further thoughts!