File upload is really slow

Moschn / neuronal-activity-analyzer

Automated activity analysis of neuronal cultures

http://neurons.ee.ethz.ch

MIT License

2 stars 0 forks source link

File upload is really slow #25

Open Moschn opened 8 years ago

Moschn commented 8 years ago

The file upload from werkzeug that is used in flask is really slow for binary files. On my machine one core is used at 100% for the entire upload duration and the speed is only around 150 kbit/s.

This is probably related to https://github.com/pallets/werkzeug/issues/875

Moschn commented 8 years ago

The problem is in the many newline characters in the uploaded files. If the tif file is compressed using the following commands, the upload is blazing fast.

convert video.tif -compress lzw compressed.tif

I dont know how to solve this.

Added a warning in d62c354

Moschn commented 8 years ago

Pillow can somehow not open lzw compressed tiff files, although this is specified in http://pillow.readthedocs.io/en/3.2.x/handbook/image-file-formats.html.