search

aai-institute / lakefs-spec

An fsspec implementation for the lakeFS project.
http://lakefs-spec.org/
Apache License 2.0
37 stars 4 forks source link

Sdk-follow-up #237

Closed maxmynter closed 6 months ago

maxmynter commented 6 months ago

Adresses point 1 from #233

Currently blocked by the fact that the lakefs API does not provide a way to discard an opened file.

nicholasjng commented 6 months ago

Re: our discussion yesterday, I opened https://github.com/treeverse/lakeFS/issues/7195 as a request for discard APIs on both reader and writer.

For now, the read/write attempt is blocked by some sharp edges in the lakefs file-like interfaces, so I think it's best to leave that point as last and focus on the remainder instead.

nicholasjng commented 6 months ago

Superseded by #240, which contains two commits cherrypicked from here.