opensearch-project / opensearch-spark

Spark Accelerator framework ; It enables secondary indices to remote data stores.
Apache License 2.0
14 stars 23 forks source link

[BUG] Request index name construction in flint streaming job creation #383

Open noCharger opened 3 months ago

noCharger commented 3 months ago

What is the bug?

  private static String constructMetaLogIndexName(String dataSourceName) {
    return dataSourceName.isEmpty() ? META_LOG_NAME_PREFIX : META_LOG_NAME_PREFIX + "_" + dataSourceName;
  }

MV and CV construction generate request index names in a hardcoded manner rather than sending them from the sql plugin. There is a inconsistency among inactive and streaming job interface.

What is the expected behavior?

Short term mitigation [Done]

Long term action