opensearch-project / opensearch-spark

Spark Accelerator framework ; It enables secondary indices to remote data stores.
Apache License 2.0
22 stars 33 forks source link

Optimization: Use external scheduler with configurable interval #622

Closed noCharger closed 1 month ago

noCharger commented 2 months ago

Flint can dynamically select between using the spark scheduler or the external scheduler based on the interval threshold level.