search

bcgov / MFIN-Data-Catalogue

The Finance Data Catalogue enables users to discover data holdings at the BC Ministry of Finance and offers information and functionality that benefits consumers of data for business purposes. The product is built using Drupal and adheres to the Government of BC's Core Administrative and Descriptive etadata Standard.
Other
6 stars 0 forks source link

implement Sysdig in the Openshift project #495

Closed NicoledeGreef closed 2 months ago

NicoledeGreef commented 5 months ago

Add Sysdig so we can have monitoring and alerts.

chrislaick commented 5 months ago

@NicoledeGreef Sysdig setup is complete with custom PromQL queries for our containers.

  1. Login to https://app.sysdigcloud.com/api/oauth/openid/bcdevops
  2. Select a Dashboard under My Dashboards

image image

chrislaick commented 5 months ago

At the moment, only the following users have access:

New users will need to be added via OC command line to the sysdig-team object.

chrislaick commented 5 months ago

Assigning to @kardamk to setup Sysdig alerts. He will take a look at how I've configured the other alerts in a1a681 and perhaps configure them similarly.

kardamk commented 4 months ago

Hi @chrislaick ,

I have added 2 more Sysdig alerts to our namespace ea352d.

  1. For container restarting within a POD for all the workloads
  2. When a container is terminated with an error for all the workloads

Do let me know what other alerts are we interested in to be set in place for MFIN data catalogue.

chrislaick commented 4 months ago

Hi @kardamk,

Could you create some alerts for PVCs nearing full?

kardamk commented 4 months ago

Hi @chrislaick,

We have an alert in place for PVC's when they are more than 90% full.

chrislaick commented 2 months ago

This is completed. There are 6 alerts in Sysdig that have been setup by @kardamk. Thanks!