NUKnightLab / StoryMapJS

Maps that tell stories.
https://storymap.knightlab.com/
Other
183 stars 50 forks source link

Import fails on large ZIP exports #487

Open JoeGermuska opened 1 year ago

JoeGermuska commented 1 year ago

In discussion in #304 we found that StoryMap creates export ZIP files containing all files associated with a project, sometimes creating a ZIP which is larger than the 20MB maximum upload supported by the system. Thus, the export cannot be re-imported.

In this specific case, there were many files in the export which were not in active use in the storymap. This is unsurprising, since there's no "delete" functionality. It's also the case that many of the images were much larger than they reasonably needed to be for display in a storymap which would almost certainly have been smaller (in pixel dimensions) than the image file.

The workaround was to create a new ZIP, omitting all image files which weren't referenced in the JSON files in the export. This imported without any issue.

We might consider filtering the images part of the export process to only include images which are actively used in the media, background, marker, or sharing image locations. It's possible in theory that we'd still create an export larger than 20MB. I don't really think it's a good idea to increase that threshold, but then, I don't know what we'd do besides tell people "sorry."

I suppose we could also consider downsampling uploaded images, although that should go in its own issue if we decide it's the right way to go.