search

wesm / feather

Feather: fast, interoperable binary data frame storage for Python, R, and more powered by Apache Arrow
Apache License 2.0
2.74k stars 168 forks source link

Reading feather #390

Closed Kevin-Brockers closed 4 years ago

Kevin-Brockers commented 4 years ago

Dear all,

Can I access a feather file with multiple tasks at the same time, similar to hdf5? I'm currently setting up a snakemake pipeline and for parallelization this would be great. Unfortunately I don't find any information about this topic.

The idea is to read only certain columns from the feather file in different rules.

All best, Kevin

wesm commented 4 years ago

Shouldn't be a problem since Feather files are immutable.