opensearch-project / opensearch-spark

Spark Accelerator framework ; It enables secondary indices to remote data stores.
Apache License 2.0
14 stars 23 forks source link

[FEATURE]PPL commands micro-benchmark support #623

Open YANG-DB opened 3 weeks ago

YANG-DB commented 3 weeks ago

Is your feature request related to a problem? Add support for micro-benchmark for each PPL command to examine the following KPI's:

What solution would you like? In a similar way to @LantaoJin comment there should be a correspondent micro-benchmark for every PPL command that can be testes independently

Do you have any additional context?

dai-chen commented 3 weeks ago

FYI, Spark microbenchmark example: https://github.com/opensearch-project/opensearch-spark/pull/291

YANG-DB commented 2 weeks ago

@dai-chen thanks for the info - I wanted to raise this issue to actually create a discussion about adding such benchmark for each PPL command - I'll add this to a new contributing.md doc...