search

logzio / elasticsearch-stress-test

Stress test tool for Elasticsearch
Apache License 2.0
271 stars 110 forks source link

Script stopping. #7

Open TalZiv opened 7 years ago

TalZiv commented 7 years ago

Hi,

first of all great work!

I am having some inconsistency issuse with the script.

Sometimes it runs well with bulk=1000 document=1 and clients=100 and sometimes it fails with lower settings, no I try to run with this command and it get killed, maybe its becuase I am sending it through NGINX loadbalancer?:

root@XXXXX:~# ./elasticsearch-stress-test.py  --es_address XXXX:8080  --indices 1 --documents 1 --seconds 60 --not-green --clients 10 --stats-frequency 5 --number-of-shards 6 --number-of-replicas 2 --bulk-size 500

Starting initialization of XXX:8080
Done!
Creating indices..
Generating documents and workers..
Done!
Starting the test. Will print stats every 5 seconds.
The test would run for 60 seconds, but it might take a bit more because we are waiting for current bulk operation to complete.

Killed

Thanks, Tal

roiravhon commented 7 years ago

Hey @TalZiv!

How about the host when running the tests? Looks like the OS killed you process, that can be from numerous reasons

TalZiv commented 7 years ago

Hi,

can you give me some pointers on what could be the cause memory, cpu?

roiravhon commented 7 years ago

I can only guess... My first thing to look would be memory as this could be killed by the OOM. Never encountered this in my own runs, but check htop or something while running and see if there is anything irregular

TalZiv commented 7 years ago

as I suspected, I will do some more digging and report back.