clessn / clessn-blend

Code used to construct the data ETL pipelines between the various data sources required for the CLESSN and the datamarts providing datasets needed for research or visualization.
2 stars 0 forks source link

Toronto Star - 2-min late scraping #53

Open SkelAlex opened 1 year ago

SkelAlex commented 1 year ago

Yesterday at 1:51 p.m. no scraping occurred for the TorStar. It instead occurred 2 min later, at 1:53. Not a big issue but just wanted to flag this for both the headline and frontpage. Headline: https://clhub.clessn.cloud/admin/core/lake/56980/change/?_changelist_filters=p%3D3. Frontpage: https://clhub.clessn.cloud/admin/core/lake/56979/change/?_changelist_filters=p%3D3.

Looking at the channel 77x_clessn-blend-radar-plus, it seems the Slack channel was updated even later (1:54) and the issue also happened at 2:03 (2 min late) and 2:12 (1 min late).

Screenshots:

Capture d’écran, le 2023-05-16 à 12 19 28 Capture d’écran, le 2023-05-16 à 12 19 33