daitss / core

DAITSS: Dark Archive In The Sunshine State
GNU General Public License v3.0
9 stars 2 forks source link

FDA GUI enhancement: switch GUI submission to an FTPS API #718

Open lydiam opened 12 years ago

lydiam commented 12 years ago

This is not a high priority at the moment, but it was agreed that we'd like to switch the FDA GUI submission process to an FTPS API instead of the current http API. This should make it possible for Affiliates to submit larger SIPs via the GUI. (I wonder if this would open the door for batch submission via the GUI as well.)

From my perspective this enhancement might become a priority if Affiliates continue to experience timeouts and problems with GUI submission that we can't resolve with the current API.

lydiam commented 12 years ago

Ira suggested that one mechanism we might consider using is a 'download manager'. A mediawiki page http://en.wikipedia.org/wiki/Download_manager that indicates that download acceleration can be accomplished on "a single file by splitting it in segments and using several simultaneous connections to download these segments from a single server." We had some bad experiences with users using GoFTP's multi-threaded uploads to our FTP server: the client didn't seem to track its threads very well and the result was that files were overwritten and ended up empty.

Uploading seems to be a secondary function of these programs.

lydiam commented 11 years ago

This project will be discussed with FDA Affiliates on December 17. Preliminary specs suggest that both single package submission and submission of a directory containing multiple packages should be enabled.

In a separate issue will deal with the DAITSS mechanism that ensures that SIPs transmitted this way are submitted.