search

opensearch-project / opensearch-spark

Spark Accelerator framework ; It enables secondary indices to remote data stores.
Apache License 2.0
12 stars 18 forks source link

Extract metadata log operations from FlintClient into FlintMetadataLogService #379

Closed seankao-az closed 1 week ago

seankao-az commented 2 weeks ago

Description

  1. Extract metadata log operations from FlintClient into FlintMetadataLogService.
  2. ~Add flint options for custom class path and instantiate FlintMetadataLogService through reflection.~ re-evaluate in another PR
  3. FlintClient.getIndexMetadata no longer attaches metadata log entry, as it has no access to FlintMetadataLogService. This is moved to FlintSpark.describeIndex.
  4. Abstract recordHeartbeat method
  5. Collect metadata log related test cases into a new suite FlintMetadataLogITSuite

Issues Resolved

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license. For more information on following Developer Certificate of Origin and signing off your commits, please check here.

noCharger commented 2 weeks ago

Any plan to move FlintClient / FlintMetadataLogService to commons module?

seankao-az commented 2 weeks ago

move FlintMetadataLogService to commons module

will do in separate PR