Monitor scheduled data loads

[peggynewman]

Regular ALA data loads:

Ref: CRON expressions https://crontogo.com/blog/the-complete-guide-to-cron/

Directory	job	description	frequency	notes
Data-resource-loads	dr376-mel-avh-weekly	Weekly upload of the MEL (National Herbarium of Victoria, Royal Botanic Gardens Victoria) AVH data resource.	Weekly Sat	H 0 6
Data-resource-loads	dr344-qm-full-load-monthly	Data-resource-loads/dr344-qm-full-load-monthly	Monthly 5th day	H H 5
Data-resource-loads	dr1411-inaturalist-weekly		Weekly Mond 9am	H 9 1
Data-resource-loads	dp3903-biocollect-monthly		Weekly Mond	H 9 1
Data-resource-loads	dr1902-questagame-weekly		Weekly Mond 11am	H 11 1
Data-resource-loads	dr15863-perth-avh-weekly	Weekly upload of the PERTH (Western Australian Herbarium) AVH data resource.	Weekly Tuesd	H 0 2
Data-resource-loads	dr368-bionet-weekly-delta	Bionet Weekly data	Weekly Wed 11am	H 11 3
Data-resource-loads	dr15860-canb-avh-weekly	Weekly upload of the Australian National Herbarium (CANB) AVH data resource (dr15860).	Weekly Thurs	H 0 4
Data-resource-loads	dr15867-cns-avh-weekly	Weekly upload of the CNS (Australian Tropical Herbarium, Cairns) AVH data resource.	Weekly Thurs	H 0 4
Data-resource-loads	dr15868-jct-avh-weekly	Weekly upload of the JCT (James Cook University, Townsville, Herbarium) AVH data resource.	Weekly Thurs	H 0 4
Data-resource-loads	dp5183-obis-seamap-monthly		Monthly 28th 11am	H 11 28
GBIF	Dwca-export-all	Create DwcA archives for all datasets	Weekly Wed 9am	Pipeline
GBIF	Dwca-export-dataset	Create DwcA archives for a dataset	Not Scheduled	Pipeline
GBIF	Dwca-package-for-gbif-all	Create Darwin Core Archives for all data resources that are delivered to GBIF	Weekly Wed 11am	Pipeline
GBIF	Dwca-package-for-gbif-dataset	Copy 'dwca' files data resource from HDFS to local directory zip them up and FTP archive to archives.ala.org.au"	Not scheduled	Pipeline
GBIF	Update-gbif-metadata	Create DwcA archives for a dataset	Not Scheduled	Pipeline