dask / hdfs3

A wrapper for libhdfs3 to interact with HDFS from Python
http://hdfs3.readthedocs.io/en/latest/
BSD 3-Clause "New" or "Revised" License
136 stars 40 forks source link

Support 'rb+' mode for open by truncation #134

Open martindurant opened 7 years ago

martindurant commented 7 years ago

HDFS does allow append, so could emulate rewrite-from-x (as needed for append by fastparquet) by truncation followed by open for append.

abigbigbird commented 5 years ago

Hello, The function completed?

martindurant commented 5 years ago

Apparently not. hdfs3 is not being developed any more, but if you need this, you may want to provide a PR yourself. The low-level function you need is hdfs3.lib.hdfsTruncate.

abigbigbird commented 5 years ago

Ok!Thx, I would try it.