JuliaML / TableTransforms.jl

Transforms and pipelines with tabular data in Julia
https://juliaml.github.io/TableTransforms.jl/stable
MIT License
102 stars 15 forks source link

Use `Distributed` processes in `ParallelTableTransforms` #286

Closed juliohm closed 3 weeks ago

juliohm commented 3 weeks ago

Threads are useful when a simple operation (ex: +, -, ...) is applied to multiple data. Transform pipelines are much more sophisticated than that in industrial applications, and call for distributed processes instead.