Add monitoring for Caliper events

[zqian]

Currently we have experienced outage of Kaltura Caliper events. It would be good to have a monitoring routine for various Caliper feeds (Canvas, Kaltura, Lecture Capture, etc.):

• [ ] check whether there is new events sent in last X hours ( X could vary: 4 hours during working hours, 6 hours during off time?)
• [ ] send alert messages with the Caliper data source marked in the subject line

Sample Caliper event queries are listed in the MyLA Wiki. Need to add time frame into the query

[jonespm]

This would either need a full rewrite of the existing monitoring queries to use BigQuery or just add in an additional BigQuery connection for this one check. I think it would be nicer if everything used BigQuery but don't know the effort of that.

The query that might be helpful for returning the last date could be this, then check if anything is older than X days. This for instance would pull the dates for the last 2 weeks, this might be fine to just have it at 1 week.

SELECT distinct ed_app.id, max(datetime(event_time)) as last_update FROM `udp-umich-prod.event_store.expanded` WHERE 
  event_time BETWEEN DATETIME_SUB(CURRENT_DATETIME(), INTERVAL 2 WEEK) AND CURRENT_DATETIME()
  group by ed_app.id
  order by last_update desc;