search

closeio / sync-engine

GNU Affero General Public License v3.0
25 stars 9 forks source link

Reduce logging volume #6

Closed jkemp101 closed 1 year ago

jkemp101 commented 4 years ago

Large Sync Engine clusters can produce an enormous volume of logs. https://github.com/closeio/nylas/pull/36 reduced this a bit but more work is needed to further reduce logging frequency. This may make it more difficult to troubleshoot some syncing issues so we could add the ability to enable per account debug logging.

dggreenbaum commented 1 year ago

This is significantly less important after moving to Loki. Loki ingests logs for ~15% of the cost of doing it in ES for the same log volume.