tschaffter
commented
1 year ago Update: I can't make Thumbor slow again
Even when proxying the requests to the API gateway, the org logos now show quickly on the org search page despite seemingly changing "nothing" for Thumbor aside creating a fresh Docker volume for it. I'm trying to understand why.
I reported the following benchmark results when downloading an image directly from Thumbor in #1641 .
vscode@0f6993f91f7e:/workspaces/sage-monorepo$ ab -n 100 http://localhost:8889/v7P2QbvYYxWnBLJeePXFv-1Y0UY=/140x140/logo/dfci.png
This is ApacheBench, Version 2.3 <$Revision: 1903618 $>
Copyright 1996 Adam Twiss, Zeus Technology Ltd, http://www.zeustech.net/
Licensed to The Apache Software Foundation, http://www.apache.org/
Benchmarking localhost (be patient).....done
Server Software: Thumbor/7.4.7
Server Hostname: localhost
Server Port: 8889
Document Path: /v7P2QbvYYxWnBLJeePXFv-1Y0UY=/140x140/logo/dfci.png
Document Length: 9600 bytes
Concurrency Level: 1
Time taken for tests: 36.368 seconds
Complete requests: 100
Failed requests: 0
Total transferred: 985300 bytes
HTML transferred: 960000 bytes
Requests per second: 2.75 [#/sec] (mean)
Time per request: 363.676 [ms] (mean)
Time per request: 363.676 [ms] (mean, across all concurrent requests)
Transfer rate: 26.46 [Kbytes/sec] received
Connection Times (ms)
min mean[+/-sd] median max
Connect: 0 0 0.1 0 1
Processing: 186 364 211.3 247 866
Waiting: 186 363 211.2 247 865
Total: 186 364 211.3 247 867
Percentage of the requests served within a certain time (ms)
50% 247
66% 308
75% 591
80% 632
90% 722
95% 802
98% 865
99% 867
100% 867 (longest request)After thinking to have figured out that the S3 result storage was what was taking so much time, I can't reproduce the previous time. The times I get now are much faster and are shown below;
Note The value of
Document Length(assuming its the image size) is the same as in the above results, which is expected since the same image is used.
vscode@0f6993f91f7e:/workspaces/sage-monorepo$ ab -n 100 http://localhost:8889/v7P2QbvYYxWnBLJeePXFv-1Y0UY=/140x140/logo/dfci.png
This is ApacheBench, Version 2.3 <$Revision: 1903618 $>
Copyright 1996 Adam Twiss, Zeus Technology Ltd, http://www.zeustech.net/
Licensed to The Apache Software Foundation, http://www.apache.org/
Benchmarking localhost (be patient).....done
Server Software: Thumbor/7.4.7
Server Hostname: localhost
Server Port: 8889
Document Path: /v7P2QbvYYxWnBLJeePXFv-1Y0UY=/140x140/logo/dfci.png
Document Length: 9600 bytes
Concurrency Level: 1
Time taken for tests: 1.463 seconds
Complete requests: 100
Failed requests: 0
Total transferred: 985300 bytes
HTML transferred: 960000 bytes
Requests per second: 68.34 [#/sec] (mean)
Time per request: 14.633 [ms] (mean)
Time per request: 14.633 [ms] (mean, across all concurrent requests)
Transfer rate: 657.57 [Kbytes/sec] received
Connection Times (ms)
min mean[+/-sd] median max
Connect: 0 0 0.0 0 0
Processing: 10 15 13.3 12 143
Waiting: 10 14 13.3 12 143
Total: 10 15 13.3 12 143
Percentage of the requests served within a certain time (ms)
50% 12
66% 13
75% 14
80% 16
90% 18
95% 21
98% 30
99% 143
100% 143 (longest request)The only think that I can think of that is different is that I cleaned up ALL my Docker resources, including the volumes, which I haven't done in a long wail. Thumbor has been configured to use one of these volumes to store original images - while the processed images are saved to S3 - for a while now and maybe the volume got messed up (or may have filled up the 200M of memory allocated to the container as I've seen before cleaning the volumes), or the large collection of docker volumes slowed down Docker altogether?
rrchai
vpchung
What projects is this story for?
OpenChallenges
As a user, I want
NA
Description
We have observed that images are displayed slowly in the web app. Sometimes images failed to be downloaded with an 500 error from the API gateway. After exploring the issue in #1641, I made the following observations:
The goal of this ticket is to make the following changes to Thumbor to improve its performance:
Acceptance criteria
No response
Tasks
No response
Anything else?
No response
Have you linked this story to a GitHub Project?