dotnet / dnceng

.NET Engineering Services
MIT License
25 stars 19 forks source link

Staging - [Alerting] Helix Service Fabric exception count alert #3968

Closed dotnet-eng-status-staging[bot] closed 3 weeks ago

dotnet-eng-status-staging[bot] commented 2 months ago

:broken_heart: Metric state changed to alerting

Helix Service Fabric exception count is high. Please check the Application Insights and check whether Helix jobs are being processed.

Metric Graph

Go to rule

@dotnet/dnceng, @dotnet/prodconsvcs, please investigate

Automation information below, do not change Grafana-Automated-Alert-Id-f391698eca5c411aa51ad5e3ba37c72e
dotnet-eng-status-staging[bot] commented 2 months ago

:green_heart: Metric state changed to ok

Helix Service Fabric exception count is high. Please check the Application Insights and check whether Helix jobs are being processed.

Metric Graph

Go to rule

dotnet-eng-status-staging[bot] commented 2 months ago

:broken_heart: Metric state changed to alerting

Helix Service Fabric exception count is high. Please check the Application Insights and check whether Helix jobs are being processed.

Metric Graph

Go to rule

dotnet-eng-status-staging[bot] commented 2 months ago

:green_heart: Metric state changed to ok

Helix Service Fabric exception count is high. Please check the Application Insights and check whether Helix jobs are being processed.

Metric Graph

Go to rule

dotnet-eng-status-staging[bot] commented 1 month ago

:broken_heart: Metric state changed to alerting

Helix Service Fabric exception count is high. Please check the Application Insights and check whether Helix jobs are being processed.

Metric Graph

Go to rule

dotnet-eng-status-staging[bot] commented 1 month ago

:green_heart: Metric state changed to ok

Helix Service Fabric exception count is high. Please check the Application Insights and check whether Helix jobs are being processed.

Metric Graph

Go to rule

dotnet-eng-status-staging[bot] commented 1 month ago

:broken_heart: Metric state changed to alerting

Helix Service Fabric exception count is high. Please check the Application Insights and check whether Helix jobs are being processed.

Metric Graph

Go to rule

dotnet-eng-status-staging[bot] commented 1 month ago

:green_heart: Metric state changed to ok

Helix Service Fabric exception count is high. Please check the Application Insights and check whether Helix jobs are being processed.

Metric Graph

Go to rule

dotnet-eng-status-staging[bot] commented 1 month ago

:broken_heart: Metric state changed to alerting

Helix Service Fabric exception count is high. Please check the Application Insights and check whether Helix jobs are being processed.

Metric Graph

Go to rule

dotnet-eng-status-staging[bot] commented 1 month ago

:green_heart: Metric state changed to ok

Helix Service Fabric exception count is high. Please check the Application Insights and check whether Helix jobs are being processed.

Metric Graph

Go to rule

dotnet-eng-status-staging[bot] commented 1 month ago

:broken_heart: Metric state changed to alerting

Helix Service Fabric exception count is high. Please check the Application Insights and check whether Helix jobs are being processed.

Metric Graph

Go to rule

dotnet-eng-status-staging[bot] commented 1 month ago

:green_heart: Metric state changed to ok

Helix Service Fabric exception count is high. Please check the Application Insights and check whether Helix jobs are being processed.

Metric Graph

Go to rule

dotnet-eng-status-staging[bot] commented 1 month ago

:broken_heart: Metric state changed to alerting

Helix Service Fabric exception count is high. Please check the Application Insights and check whether Helix jobs are being processed.

Metric Graph

Go to rule

dotnet-eng-status-staging[bot] commented 1 month ago

:green_heart: Metric state changed to ok

Helix Service Fabric exception count is high. Please check the Application Insights and check whether Helix jobs are being processed.

Metric Graph

Go to rule

dotnet-eng-status-staging[bot] commented 1 month ago

:broken_heart: Metric state changed to alerting

Helix Service Fabric exception count is high. Please check the Application Insights and check whether Helix jobs are being processed.

Metric Graph

Go to rule

dotnet-eng-status-staging[bot] commented 1 month ago

:green_heart: Metric state changed to ok

Helix Service Fabric exception count is high. Please check the Application Insights and check whether Helix jobs are being processed.

Metric Graph

Go to rule

dotnet-eng-status-staging[bot] commented 1 month ago

:broken_heart: Metric state changed to alerting

Helix Service Fabric exception count is high. Please check the Application Insights and check whether Helix jobs are being processed.

Metric Graph

Go to rule

dotnet-eng-status-staging[bot] commented 1 month ago

:green_heart: Metric state changed to ok

Helix Service Fabric exception count is high. Please check the Application Insights and check whether Helix jobs are being processed.

Metric Graph

Go to rule

dotnet-eng-status-staging[bot] commented 1 month ago

:broken_heart: Metric state changed to alerting

Helix Service Fabric exception count is high. Please check the Application Insights and check whether Helix jobs are being processed.

Metric Graph

Go to rule

dotnet-eng-status-staging[bot] commented 1 month ago

:green_heart: Metric state changed to ok

Helix Service Fabric exception count is high. Please check the Application Insights and check whether Helix jobs are being processed.

Metric Graph

Go to rule

dotnet-eng-status-staging[bot] commented 1 month ago

:broken_heart: Metric state changed to alerting

Helix Service Fabric exception count is high. Please check the Application Insights and check whether Helix jobs are being processed.

Metric Graph

Go to rule

dotnet-eng-status-staging[bot] commented 1 month ago

:green_heart: Metric state changed to ok

Helix Service Fabric exception count is high. Please check the Application Insights and check whether Helix jobs are being processed.

Metric Graph

Go to rule

dotnet-eng-status-staging[bot] commented 1 month ago

:broken_heart: Metric state changed to alerting

Helix Service Fabric exception count is high. Please check the Application Insights and check whether Helix jobs are being processed.

Metric Graph

Go to rule

dotnet-eng-status-staging[bot] commented 1 month ago

:green_heart: Metric state changed to ok

Helix Service Fabric exception count is high. Please check the Application Insights and check whether Helix jobs are being processed.

Metric Graph

Go to rule

dotnet-eng-status-staging[bot] commented 1 month ago

:broken_heart: Metric state changed to alerting

Helix Service Fabric exception count is high. Please check the Application Insights and check whether Helix jobs are being processed.

Metric Graph

Go to rule

dotnet-eng-status-staging[bot] commented 1 month ago

:green_heart: Metric state changed to ok

Helix Service Fabric exception count is high. Please check the Application Insights and check whether Helix jobs are being processed.

Metric Graph

Go to rule

dotnet-eng-status-staging[bot] commented 1 month ago

:broken_heart: Metric state changed to alerting

Helix Service Fabric exception count is high. Please check the Application Insights and check whether Helix jobs are being processed.

Metric Graph

Go to rule

dotnet-eng-status-staging[bot] commented 1 month ago

:green_heart: Metric state changed to ok

Helix Service Fabric exception count is high. Please check the Application Insights and check whether Helix jobs are being processed.

Metric Graph

Go to rule

dotnet-eng-status-staging[bot] commented 1 month ago

:broken_heart: Metric state changed to alerting

Helix Service Fabric exception count is high. Please check the Application Insights and check whether Helix jobs are being processed.

Metric Graph

Go to rule

dotnet-eng-status-staging[bot] commented 1 month ago

:green_heart: Metric state changed to ok

Helix Service Fabric exception count is high. Please check the Application Insights and check whether Helix jobs are being processed.

Metric Graph

Go to rule

dotnet-eng-status-staging[bot] commented 1 month ago

:broken_heart: Metric state changed to alerting

Helix Service Fabric exception count is high. Please check the Application Insights and check whether Helix jobs are being processed.

Metric Graph

Go to rule

dotnet-eng-status-staging[bot] commented 1 month ago

:green_heart: Metric state changed to ok

Helix Service Fabric exception count is high. Please check the Application Insights and check whether Helix jobs are being processed.

Metric Graph

Go to rule

dotnet-eng-status-staging[bot] commented 1 month ago

:broken_heart: Metric state changed to alerting

Helix Service Fabric exception count is high. Please check the Application Insights and check whether Helix jobs are being processed.

Metric Graph

Go to rule

dotnet-eng-status-staging[bot] commented 1 month ago

:green_heart: Metric state changed to ok

Helix Service Fabric exception count is high. Please check the Application Insights and check whether Helix jobs are being processed.

Metric Graph

Go to rule

dotnet-eng-status-staging[bot] commented 1 month ago

:broken_heart: Metric state changed to alerting

Helix Service Fabric exception count is high. Please check the Application Insights and check whether Helix jobs are being processed.

Metric Graph

Go to rule

dotnet-eng-status-staging[bot] commented 1 month ago

:green_heart: Metric state changed to ok

Helix Service Fabric exception count is high. Please check the Application Insights and check whether Helix jobs are being processed.

Metric Graph

Go to rule

dotnet-eng-status-staging[bot] commented 1 month ago

:broken_heart: Metric state changed to alerting

Helix Service Fabric exception count is high. Please check the Application Insights and check whether Helix jobs are being processed.

Metric Graph

Go to rule

dotnet-eng-status-staging[bot] commented 1 month ago

:green_heart: Metric state changed to ok

Helix Service Fabric exception count is high. Please check the Application Insights and check whether Helix jobs are being processed.

Metric Graph

Go to rule

garath commented 1 month ago

Be aware: FR is not investigating failures in helix staging while the extra level of testing is occurring. See this thread for details and discussion.

I'll keep this issue open in the meantime, but no actions will be taken.

ilyas1974 commented 3 weeks ago

old alert - closing issue.