search

bcgov / DITP-DevOps

Digital Identity and Trust Program Team's DevOps Documentation Repository
Apache License 2.0
2 stars 6 forks source link

Investigate missing data on the DTS Service sysdig dashboards #22

Closed WadeBarnes closed 1 year ago

WadeBarnes commented 2 years ago

I know we were experiencing issues with the data on the prod instance of the DTS Service sysdig dashboard, but now all of them are affected. The time the data went missing on the dashboards corresponds to when I was making resource adjustments in those environments. Could it be the metrics where being picked recorded from specific pod instances rather than based more generic container names?

Please have a look that the metrics collection to track down the reason for the missing data.

WadeBarnes commented 1 year ago

@rajpalc7, While your are working on this issue you please be thinking about the items mentioned here; https://github.com/bcgov/DITP-DevOps/issues/24

WadeBarnes commented 1 year ago

This issue has not been resolved see my message here; https://github.com/bcgov/DITP-DevOps/issues/13#issuecomment-1337736350. The metrics appear to be tracking named pod/container instances.

rajpalc7 commented 1 year ago

@WadeBarnes - Closing this ticket as we have another ticket open related to this issue . - Investigate missing data on sysdig dashboards#24

WadeBarnes commented 1 year ago

This ticket and #24 are tracking different issues. #24 is tracking an issue where data is missing for a few minutes at a time, while this one is tracking data going missing for a long period of time.

rajpalc7 commented 1 year ago

The agents were updated and all the missing data is available now.

WadeBarnes commented 1 year ago

Complete