Azure / azure-kusto-spark

Apache Spark Connector for Azure Kusto
Apache License 2.0
77 stars 35 forks source link

Container cache refresh fails the ingestion #303

Closed ohadbitt closed 6 months ago

ohadbitt commented 1 year ago

Describe the bug A refresh of ContainerProvider that fails shouldnt throw if an older value was fetched successfully.

To Reproduce Its transient. On debug mode - basically wait for the refresh period to expire after one successful ingestion, then stop the DM, the next call to getAllContainers will fail and throw instead of returning old value.

Additional context Maybe the whole class should be rewritten to something similar to the timer in our java sdk ResourceManager class