FTP upload slow, inefficient - try a mass-upload system

[mathewlippincott]

(it currently requires PLOTS staff contact, which is a bottleneck)

is there a way to provide a web -form upload system, so that users can get going on Mapmill without PLOTS staff contacts, or making people learn to use FTPs?

[jywarren]

Copying in from my email:

• MapMill was an experiment... personally i'm not using it much anymore and I kind of suggest ditching it as part of our formal process? it is very high maintenance, but not because it's poorly engineered... more because it's an inherently difficult problem. Thoughts?
• writing a custom downloadable application may be the only viable strategy i can think of... something kind of like Dropbox crossed with an FTP program, or like the Flickr Uploadr. But this is not really a short-term project.
• what about coming up with a protocol for dividing up an image set and sorting it manually, or something?
• alternatively, having a larger group of MapMill admins, who are regionally responsible for getting datasets online and up on MapMill. Mailing SD cards as a viable way to send in data to a MapMill admin.
• NYC is already sorting out only a couple hundred to upload to MapMill. That almost makes it unnecessary, no?

I wanna emphasize that i'm not giving up here because it's "hard" - but that given how much trouble we've had with this, and how much time we've sunk into it, I want to spend a little time evaluating options before diving into a protracted process.

[jywarren]

Up to 2gb file uploads using Flash are available with this module: http://drupal.org/project/swfupload. YouTube allows up to 2gb uploads. This might alternatively be used for multiple file upload of each file.

[mathewlippincott]

yeah... see my response in the other thread. I think you're right, its not worth it- pain in the ass with little benefit, especially to slow internet users. we'll make manual sorting instructions.

On Mon, Jan 16, 2012 at 2:43 PM, Jeffrey Warren < reply@reply.github.com

wrote:

Up to 2gb file uploads using Flash are available with this module: http://drupal.org/project/swfupload. YouTube allows up to 2gb uploads. This might alternatively be used for multiple file upload of each file.

---

Reply to this email directly or view it on GitHub: https://github.com/jywarren/mapmill/issues/6#issuecomment-3519769

[jywarren]

Funny random idea..... what about multiple user sorting on the same web page using different keys on the keyboard? What different people would use the keys QWE,ZXC,IOP,BNM for each of 4 separate images, (like multi player Goldeneye). Or a local version of the same thing; a desktop application so you don't have to upload but you still get the benefit of multiple people working on it at the same time. On Jan 16, 2012 5:54 PM, "mathew lippincott" < reply@reply.github.com> wrote:

yeah... see my response in the other thread. I think you're right, its not worth it- pain in the ass with little benefit, especially to slow internet users. we'll make manual sorting instructions.

On Mon, Jan 16, 2012 at 2:43 PM, Jeffrey Warren < reply@reply.github.com

wrote:

Up to 2gb file uploads using Flash are available with this module: http://drupal.org/project/swfupload. YouTube allows up to 2gb uploads. This might alternatively be used for multiple file upload of each file.

---

Reply to this email directly or view it on GitHub: https://github.com/jywarren/mapmill/issues/6#issuecomment-3519769

---

Reply to this email directly or view it on GitHub: https://github.com/jywarren/mapmill/issues/6#issuecomment-3519905

[jywarren]

hypr3d.com makes me much more optimistic about a multipart-file upload system where you select many individual images (we could allow only JPG images, no zips or folders) and it just tries to upload them all as fast as possible in a giant web form. hypr3d.com actually works OK! I could move the file storage onto Amazon S3 so we don't have to worry about how much storage people are using.

[jywarren]

closing due to MapMill 2: https://github.com/publiclab/mapmill