Cannot upload large WARC

Rhizome-Conifer / conifer

Collect and revisit web pages.

https://conifer.rhizome.org

Apache License 2.0

1.48k stars 119 forks source link

Cannot upload large WARC #222

Open despens opened 8 years ago

despens commented 8 years ago

Uploading a 29GB WARC file is canceled after a few megabytes in both Chrome and Firefox.

despens commented 8 years ago

Upon further investigation, there seems to be a 30 seconds timeout somewhere… selection_791

There is no response at all from webrecorder.io

ikreymer commented 8 years ago

Nginx had a max upload size limit set.. I've lifted it on the test machine so you can try.. but will probably want to keep it at something reasonable for now (eg. around 5GB).

despens commented 7 years ago

30 GB WARC file stalls after completing "upload" phase, stuck at 50%

selection_999 155 selection_999 156