fullstorydev / solr-bench

Solr benchmarking and load testing harness
Apache License 2.0
17 stars 10 forks source link

Adding capability of connecting to external Solr cluster #33

Closed chatman closed 1 year ago

chatman commented 1 year ago

Existing Solr clusters can be used for benchmarking. They don't need to be spun up (terraform or local mode), instead they just need to be connected to. In order for solr-bench to restart the nodes in this externally provisioned cluster, the user would need to provide a pluggable restart-node bash script.

chatman commented 1 year ago

This is an old branch that we forgot to merge earlier. FYI @hiteshk25 @patsonluk @noblepaul. I'll fix the merge conflicts and update this PR shortly.

patsonluk commented 1 year ago

@chatman We can probably close this one. Thank you!

I have merged most of the changes into https://github.com/fullstorydev/solr-bench/tree/patsonluk/solr-perf-v2 . Adding some extra capability on top:

  1. Allow configuration of chroot
  2. Discover QA nodes as well, and use it for query benchmark
chatman commented 1 year ago

Thanks @patsonluk .

FYI, we were querying QA nodes (coordinator nodes) using this: https://github.com/fullstorydev/solr-bench/blob/master/suites/coordinator-node.json#L40 https://github.com/fullstorydev/solr-bench/blob/master/suites/coordinator-node.json#L40

Here 2 refers to the second node in the cluster. That one was set to be the coordinator, as here: https://github.com/fullstorydev/solr-bench/blob/master/suites/coordinator-node.json#L117

chatman commented 1 year ago

However, the with latest merge to master, this suite might have fallen a bit behind (repository vs. repositories section). I'll update it soon and setup the coordinator test publicly.

Right now, two of htem are setup publicly: http://mostly.cool.

Discussion is here: https://issues.apache.org/jira/browse/SOLR-16525