pinterest / singer

A high-performance, reliable and extensible logging agent for uploading data to Kafka, Pulsar, etc.
Apache License 2.0
182 stars 35 forks source link

Initialize ostrich metrics service before main initialize #400

Closed jfzunigac closed 6 months ago

jfzunigac commented 6 months ago

When a log directory contains a large number of files, the initialization of all log streams in the directory can take some time for Singer after a restart. However, by initiating the metrics service prior to SingerSettings.initialize(), we can continue to publish metrics while Singer finalizes the log stream initialization process.