search

korydraughn / irods_client_mingr

BSD 3-Clause "New" or "Revised" License
0 stars 0 forks source link

Add support for several Data Object operations #7

Open korydraughn opened 5 months ago

korydraughn commented 5 months ago

Must Haves

Maybes

The following operations need more thought. Uploading large files over HTTP probably isn't the best answer given timeout settings and other limits. Small files (<= 200MB) are fine.

These operations may be something the admin needs to grant access to. Some admins may be okay letting users perform these operations. Other admins may not.

The following operations require the user to know about resources, which is probably out of scope of this project. Needs more thought.

korydraughn commented 5 months ago

One way to handle uploads is to have the HTTP server (flask) write the files to local storage and register the files in the iRODS catalog. This is simple and keeps things speedy. Of course, this means the iRODS server must have access to the storage.

Alternatively, the file must be streamed twice. One time to the HTTP server (flask). And one more time from the flask server to the HTTP API. That's a total of 3 hops.

korydraughn commented 5 months ago

Another source of information that may be useful.