clearlydefined / service

The service side of clearlydefined.io

MIT License

45 stars 41 forks source link

Ljones140/reduce logging #1201

Closed ljones140 closed 1 month ago

ljones140 commented 1 month ago

What

Reduces high amount of logging to App Insights by reducing our busiest logs to debug level.
Log level will default to info can be changed using new env var APPINSIGHTS_EXPORT_LOG_LEVEL
Can be changed via App Service config without a code change

Logging library docs https://github.com/bragma/winston-azure-application-insights/blob/cfffb48e8761072a6d8aa0e9a122b46f42d26d49/README.md

Why

App Insights is our biggest cost

Kusto query for working out busiest logs

traces
| summarize messageCount=count() by bin(timestamp, 1h), message
| order by messageCount

Testing

Tested in dev setting APPINSIGHTS_EXPORT_LOG_LEVEL to debug and logs appeared Set to info and the debug level logs did not appear