search

thumbor-community / aws

Thumbor AWS extensions
MIT License
155 stars 70 forks source link

Cannot load files from S3 bucket larger than 100mb #143

Closed janisbiz closed 1 year ago

janisbiz commented 4 years ago

When trying to load an file larger than 100mb using presigned loader, this is what happens. Would be great to add configuration for changing the size.

Stacktrace

thumbor_1    | host
thumbor_1    | UNSIGNED-PAYLOAD
thumbor_1    | 2020-03-29 21:58:52 botocore.auth:DEBUG StringToSign:
thumbor_1    | AWS4-HMAC-SHA256
thumbor_1    | 20200329T215852Z
thumbor_1    | 0ebe6b918cb388d4ebb4722c6f3174f582cbe554b4aea349024942fd2018342f
thumbor_1    | 2020-03-29 21:58:52 botocore.auth:DEBUG Signature:
thumbor_1    | bc61cb6b5403e23edf2ad8d7e1cbcea77578a7d97831a25e861904c5bed95c8b
thumbor_1    | 2020-03-29 21:58:52 tornado.general:INFO Malformed HTTP message from None: Content-Length too long
thumbor_1    | 2020-03-29 21:58:52 thumbor:DEBUG METRICS: inc: original_image.status.599:1
thumbor_1    | 2020-03-29 21:58:52 thumbor:WARNING ERROR retrieving image. Connection closed
thumbor_1    | 2020-03-29 21:58:52 tornado.access:ERROR 504 GET [path to file] (172.24.0.8) 611.02ms

Versions

botocore==1.15.31
tc-aws==6.2.15
thumbor==6.7.5
tornado==5.1.1
tornado-botocore==1.5.0

Steps to reproduce

  1. Upload an image file > 100mb to s3
  2. Try to access it with whatever resizing
Bladrak commented 1 year ago

Cleaning up old issues, feel free to reopen if it's still present with the latest releases