search

fullstorydev / solr-bench

Solr benchmarking and load testing harness
Apache License 2.0
17 stars 10 forks source link

Validations support #44

Closed chatman closed 1 year ago

chatman commented 1 year ago

Added support for validating results of query benchmark tasks.

Workflow for a user:

  1. Run their suite with -g (generate validation) flag. This will generate a file in the suites/ dir containing a tuple <query, numFound, facets>.
  2. When satisfied with the generated file, the same can be used for validations subsequently as follows: a. Add a "validation": "" parameter in the query-benchmark definition, b. Run stress.sh with a -v (validate) flag. It will use the validations file in the query benchmark task and report number of successful and failed queries.
hiteshk25 commented 1 year ago

Thanks @chatman good to see this feature!

chatman commented 1 year ago

FYI, this cannot be merged at the moment. Master branch has some errors, looking into them (https://github.com/fullstorydev/solr-bench/issues/62).

chatman commented 1 year ago

Struggling to fix the merge conflicts, so opened a new one: https://github.com/fullstorydev/solr-bench/pull/66