datopian / ckan-client-py

Python SDK for CKAN with v3 style cloud storage.
https://tech.datopian.com/ckan-client-guide/
MIT License
3 stars 1 forks source link

Multi-part support #24

Open rufuspollock opened 3 years ago

rufuspollock commented 3 years ago

@shevron can you detail what we need to do to have this python client have multi-part support.

shevron commented 3 years ago
  1. upload.py and Client.push_blob needs to be rewritten in a way that supports different transfer protocols + negotiation;
  2. multipart-basic transfer protocol needs to be implemented, or copied / imported from giftless.client. Perhaps the best approach is to create a stand-alone giftless-client package that contains a generic LFS client with multipart support, and just use this, because relying on giftless as a dependency here makes little sense as it requires things that you don't want here, such as flask, and also requires a minimal Python version 3.7 or 3.8 IIRC.

I believe that this is more or less it.