Open zqian opened 2 months ago
This would either need a full rewrite of the existing monitoring queries to use BigQuery or just add in an additional BigQuery connection for this one check. I think it would be nicer if everything used BigQuery but don't know the effort of that.
The query that might be helpful for returning the last date could be this, then check if anything is older than X days. This for instance would pull the dates for the last 2 weeks, this might be fine to just have it at 1 week.
SELECT distinct ed_app.id, max(datetime(event_time)) as last_update FROM `udp-umich-prod.event_store.expanded` WHERE
event_time BETWEEN DATETIME_SUB(CURRENT_DATETIME(), INTERVAL 2 WEEK) AND CURRENT_DATETIME()
group by ed_app.id
order by last_update desc;
Currently we have experienced outage of Kaltura Caliper events. It would be good to have a monitoring routine for various Caliper feeds (Canvas, Kaltura, Lecture Capture, etc.):
Sample Caliper event queries are listed in the MyLA Wiki. Need to add time frame into the query