elastic / rally

Macrobenchmarking framework for Elasticsearch
Apache License 2.0
1.91k stars 314 forks source link

Add looped mode to bulk operation #1830

Closed gbanasiak closed 4 months ago

gbanasiak commented 4 months ago

Adds looped mode to bulk operation. That is useful in benchmarks where we want Rally to ingest for a specific amount of time even if corpus is not big enough to sustain indexing at a specific rate for this time.

This mode is meant to be used together with time-period or iterations at the task level. Otherwise Rally will never complete the task.

Example use:

{
  "name": "some-bulk-task",
  "operation": {
    "operation-type": "bulk",
    "bulk-size": 5000,
    "looped": true
  },
  "time-period": 300,
  "target-throughput": 2
}
gbanasiak commented 4 months ago

Re-running IT test failure of which seems unrelated.