opensearch-project / opensearch-benchmark-workloads

Official workloads used by OpenSearch Benchmark (OSB)
https://opensearch.org/docs/latest/benchmark/
11 stars 58 forks source link

Adding semantic search with hybrid query workload #292

Closed martin-gaievski closed 1 month ago

martin-gaievski commented 1 month ago

Description

Adding semanticsearch workload that includes noaa dataset for creating index and ingesting documents and hybrid query for search part.

As per guide integ tests ran successfully as part of https://github.com/opensearch-project/opensearch-benchmark/pull/535/checks

Issues Resolved

https://github.com/opensearch-project/opensearch-benchmark-workloads/issues/291

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license. For more information on following Developer Certificate of Origin and signing off your commits, please check here.

IanHoang commented 1 month ago

~For readability purposes, can the directory be renamed to semantic_search?~

Also, we have another contributor who is adding a workload under the same name. It'd be better to make the workload name more specific than semantic_search (such as noaa_semantic_search).

martin-gaievski commented 1 month ago

~For readability purposes, can the directory be renamed to semantic_search?~

Also, we have another contributor who is adding a workload under the same name. It'd be better to make the workload name more specific than semantic_search (such as noaa_semantic_search).

Makes sense, I'll rename to noaa_semantic_search

VijayanB commented 1 month ago

@martin-gaievski Does this needs to be back ported to 1.x?

martin-gaievski commented 1 month ago

@martin-gaievski Does this needs to be back ported to 1.x?

no need to backport it to 1

martin-gaievski commented 1 month ago

@IanHoang can you please take one more final look before it's merged?