search

criteo / cluster-pack

A library on top of either pex or conda-pack to make your Python code easily available on a cluster
Apache License 2.0
45 stars 21 forks source link

use fsspec instead of custom generic filesystem #87

Open rom1504 opened 2 years ago

rom1504 commented 2 years ago

https://github.com/criteo/cluster-pack/blob/master/cluster_pack/filesystem.py

fhoering commented 2 years ago

+1 on this. It should be possible now with arrow 6.0.0:

Do you want to try to submit a PR ?