Scalable Cytometry Image Processing (SCIP) is an open-source tool that implements an image processing pipeline on top of Dask, a distributed computing framework written in Python. SCIP performs projection, illumination correction, image segmentation and masking, and feature extraction.
Most likely due to features being collected to one node in the delayed call to final. Fix by indexing features, joining with meta, and calling to_parquet directly on Dask DataFrame, rather then on pandas DataFrame in final.
Most likely due to features being collected to one node in the delayed call to
final. Fix by indexing features, joining with meta, and callingto_parquetdirectly on Dask DataFrame, rather then on pandas DataFrame infinal.