search

ckan / ideas

[DEPRECATED] Use the main CKAN repo Discussions instead:
https://github.com/ckan/ckan/discussions
40 stars 2 forks source link

Direct to $online_storage_provider upload #141

Open rossjones opened 9 years ago

rossjones commented 9 years ago

CKAN used to support direct upload to various services, and they were deprecated in favour of the filestore.

It would be nice now that the storage solution is a lot cleaner to now add back in the ability to write directly to cloud storage providers without routing the request through CKAN, or relying on ckanext-s3archive.

jqnatividad commented 9 years ago

+1

wardi commented 9 years ago

suggest we change the idea to "Direct to $online_storage_provider upload". The last time this feature was added IIUC it had to be removed because it was too S3-specific.

wardi commented 9 years ago

Is there any reason this can't be 100% javascript? We let the client's browser upload the file then the form is filled with a link to where the file may be downloaded. What's left to do?

rossjones commented 9 years ago 
 What's left to do?

The same thing time and time again ;) It'd be nice to provide that as part of the base CKAN so that everyone didn't have to re-invent the wheel.

I think 100% JS would even be preferable, no point streaming it through nginx+apache+wsgi.

wardi commented 9 years ago

@rossjones ok, but what's wrong with implementing this as one or multiple separate extensions that override the resource edit form?

maxious commented 9 years ago

FYI I recently started writing a javascript client side upload, S3-specific extension https://github.com/maxious/ckanext-s3multipart

I'd still like to lock down the access a little more to a specific prefix inside a bucket, and sticking all the JS in base.html is an ugly hack to avoid fanstatic while I'm developing but it works as a proof of concept.

Something like this for Windows Azure Storage would also be possible http://gauravmantri.com/2013/02/16/uploading-large-files-in-windows-azure-blob-storage-using-shared-access-signature-html-and-javascript/