Monitor Data Loads : Week commencing 19/09/2022

[rosemaryjoconnor]

• [ ] After creation, add this issue to the Data Management project board https://github.com/orgs/AtlasOfLivingAustralia/projects/9

Jenkins Access

• SSH:   ssh -L 9194:127.0.0.1:9194 aws-spark-quoll-master.ala
• Data resource loads: http://aws-spark-quoll-master.ala:9194/job/Data-resource-loads/
• GBIF Loads: http://aws-spark-quoll-master.ala:9194/job/GBIF

Reference

• Jenkins - Automated Data Load Schedule: https://confluence.csiro.au/display/ALASD/Jenkins+-+Automated+Data+Load+Schedule

---

Monitoring Schedule - automated jobs are to be monitored twice per week on Tuesday and Friday.

Please enter Week commencing date: 19/09/2022

Tuesday Monitoring

• [x] dp3903-biocollect-monthly
• [x] dr1411-inaturalist-weekly
• [x] dr15863-perth-avh-weekly
• [x] dr1902-questagame-weekly
• [x] dr368-bionet-weekly-delta
• [x] dr376-mel-avh-weekly

Friday Monitoring

• [x] Dwca-export-all
• [x] Dwca-package-for-gbif-all
• [ ] dr10574-ho-avh-weekly
• [x] dr15860-canb-avh-weekly
• [x] dr15867-cns-avh-weekly
• [x] dr15868-jct-avh-weekly
• [ ] dr2153-nzvh-avh-weekly
• [ ] dr341-canb-anwc-weekly
• [x] dr7973-cPlatypus-weekly

There are also quarterly and monthly jobs that will need to be checked on the following days of the month:

3rd of month quarterly - Feb, May, Sept, Nov

• [ ] dr365,dr366-BDBSA-quarterly

5th day of month

• [x] dr344-qm-full-load-monthly

28th day of month

• [ ] dp5183-obis-seamap-monthly