vkuznet
commented
5 months ago For tests below I used common CouchDB version obtained from their official site and docker hub. The version is 3.3.3
Docker setup
- install docker container docker pull couchdb
- create common database area, e.g. mkdir /path/data
- run docker container docker run -e COUCHDB_USER=admin -e COUCHDB_PASSWORD=password -p 5984:5984 --volume /path/data:/opt/couchdb/data couchdb
CouchDB initialization
- create necessary couch DBs:
curl -X PUT http://admin:password@127.0.0.1:5984/_users curl -X PUT http://admin:password@127.0.0.1:5984/_replicator curl -X PUT http://admin:password@127.0.0.1:5984/_global_changes curl -X PUT http://admin:password@127.0.0.1:5984/test
Load/stress tests
- prepare JSON documents to inject concurrently
- take existing WM JSON from https://cmsweb.cern.ch/reqmgr2 service and name it as wm.json
- perform load/stress test using hey tool [2]
# inject first document curl -X POST http://admin:password@127.0.0.1:5984/test -H "Content-Type: application/json" -d@/wma/vk/CouchDB/wm.json {"ok":true,"id":"e05f6d85f7fe72b02709decb2a000c58","rev":"1-be003cb86351088da81258cd77a55ea4"}
perform load/stress test
hey -n 200 -c 50 -m POST -H "Content-Type: application/json" -D /path/wm.json -disable-keepalive /afs/cern.ch/user/v/valya/public/hey_linux -n 200 -c 50 -m POST -H "Content-Type: application/json" -D /wma/vk/CouchDB/wm.json -disable-keepalive -disable-compression http://admin:password@localhost:5984/test 2>&1 1>& log
Results are the following:69 requests done. 182 requests done. All requests done.
Summary: Total: 1.0729 secs Slowest: 0.4308 secs Fastest: 0.0258 secs Average: 0.2296 secs Requests/sec: 186.4051 Total data: 19000 bytes Size/request: 95 bytes
Status code distribution: [201] 200 responses
Response time histogram: 0.026 [1] |∎ 0.066 [31] |∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎ 0.107 [0] | 0.147 [12] |∎∎∎∎∎∎∎∎∎∎∎ 0.188 [8] |∎∎∎∎∎∎∎ 0.228 [44] |∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎ 0.269 [36] |∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎ 0.309 [17] |∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎ 0.350 [17] |∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎ 0.390 [27] |∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎ 0.431 [7] |∎∎∎∎∎∎
Latency distribution: 10% in 0.0424 secs 25% in 0.1867 secs 50% in 0.2357 secs 75% in 0.3330 secs 90% in 0.3828 secs 95% in 0.3859 secs 99% in 0.4307 secs
### Local CouchDB setup
installation instructions
sudo yum install -y yum-utils sudo yum-config-manager --add-repo https://couchdb.apache.org/repo/couchdb.repo sudo dnf config-manager --set-enabled crb sudo dnf install epel-release epel-next-release sudo yum install -y mozjs78 sudo yum install -y couchdb
initial setup, see
https://docs.couchdb.org/en/latest/install/unix.html#installation-using-the-apache-couchdb-convenience-binary-packages
enable admin login name and password
sudo vim /opt/couchdb/etc/local.ini
start local couchdb
sudo -i -u couchdb /opt/couchdb/bin/couchdb
At this step I performed `CouchDB initialization` steps to setup _users and other dbs.
Finally, I repeat steps listed in `Load/stress tests` and got the following results:All requests done.
Summary: Total: 0.0543 secs Slowest: 0.0227 secs Fastest: 0.0045 secs Average: 0.0123 secs Requests/sec: 3683.9033 Total data: 19000 bytes Size/request: 95 bytes
Status code distribution: [201] 200 responses
Response time histogram: 0.004 [1] |∎ 0.006 [9] |∎∎∎∎∎∎∎∎∎ 0.008 [20] |∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎ 0.010 [32] |∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎ 0.012 [37] |∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎ 0.014 [18] |∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎ 0.015 [42] |∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎ 0.017 [28] |∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎∎ 0.019 [2] |∎∎ 0.021 [3] |∎∎∎ 0.023 [8] |∎∎∎∎∎∎∎∎
Latency distribution: 10% in 0.0077 secs 25% in 0.0093 secs 50% in 0.0118 secs 75% in 0.0151 secs 90% in 0.0163 secs 95% in 0.0206 secs 99% in 0.0225 secs
### Results comparison
How it can be see from above benchmark results we have the following:
- local CouchDB
- almost 3700 request per second for POST HTTP calls
- docker CouchDB
- below 200 request per second for POST HTTP calls
### TODO
- setup both instances, i.e. local CouchDB and docker CouchDB and run tests outside of the node, i.e. run hey tool from another node to add more network latency
- try different http benchmarks, i.e. POST and GET
- change number of concurrent calls
### References
[1] https://hub.docker.com/_/couchdb/
[2] https://github.com/rakyll/hey or
use vkuznet port patched to support X509: https://github.com/vkuznet/hey
amaltaro
anpicci
Impact of the new feature WMAgent
Is your feature request related to a problem? Please describe. As part of running WMAgent in a container environment, composed with database containers as well. We need to perform load/stress tests to evaluate the performance of CouchDB container.
Describe the solution you'd like Come up with a reliable and meaningful setup to evaluate the performance (latency and throughput, etc) of CouchDB in two deployment modes:
To be provided with this issue:
Describe alternatives you've considered None
Additional context Depends on: https://github.com/dmwm/WMCore/issues/11312 Part of the following meta issue: https://github.com/dmwm/WMCore/issues/11314