search

ORNL / DataFed

A Federated Scientific Data Management System
https://ornl.github.io/DataFed/
Other
18 stars 14 forks source link

HTTPS upload and download #571

Open ssomnath opened 3 years ago

ssomnath commented 3 years ago

I feel that DataFed should have HTTPS upload and download capabilities. It would be fine to just limit this capability at the web portal. Perhaps this option could be enabled / disabled depending on a file size threshold.

We will effectively have a HTTPS upload capability planned already via the Virtual Gateway. I am wondering if this capability should be separate from DataFed or somehow be integrated into DataFed itself.

ssomnath commented 3 years ago

Posting @dvstans response on his behalf:

I'm not philosophically opposed to https upload/download; however, the DataFed services were not designed with this in mind and is a very significant effort to implement. (Probably 50% of the core service is dedicate to Globus transfer support). (There is already a ticket for an http CDN feature for media attachments.)

dvstans commented 3 years ago

This issue needs to be discussed in the context of potential built-in data ingest features (if the data gateway does not happen).

JoshuaSBrown commented 1 year ago

The advantages of this:

  1. Possibly improved user experience at least for small files
  2. User does not have to have globus installed locally to get files

The disadvantageous

  1. Possible performance hits.
  2. Possibly large refactor.