kbase / staging_service

MIT License
0 stars 9 forks source link

Improve handling of compressed files, esp. with bulk import #104

Open MrCreosote opened 3 years ago

MrCreosote commented 3 years ago

Currently, if a user uploads a large number of compressed files with the bulk import improvements they're autoselected as decompress. If the user imports those files, they are taken to a narrative and a decompress app is added for each file, which is not very user friendly.

The other option is the decompress button on the left side of the file name, but users often miss this button entirely in tests or do not understand its purpose. The button is much easier to use and typically decompresses much faster than the app once discovered, but it puts additional load on the service. The apps often run on separate machines with an NFS mount for the staging area.

Rethink how to handle these cases and improve UX.

Note - the DU team is currently updating apps and the UI to handle compressed versions of some file formats (for example *.fasta.gz)

MrCreosote commented 3 years ago

Another feature that could be useful is the ability to extract an archive into individual gzipped files ready for upload apps without creating the uncompressed intermediate files.