Adds two variants on the map-reduce pipeline. Both use lightweight components, support user-specified n_samples at runtime, and store data in minio. One uses lightweight components written to interact with minio directly, the other uses reusable components from elsewhere.
ca-scribner
commented
4 years ago
Adds two variants on the map-reduce pipeline. Both use lightweight components, support user-specified n_samples at runtime, and store data in minio. One uses lightweight components written to interact with minio directly, the other uses reusable components from elsewhere.