search

AtlasOfLivingAustralia / data-management

Data management issue tracking
7 stars 0 forks source link

DR341 - Schedule ANWC weekly job #759

Closed peggynewman closed 2 years ago

peggynewman commented 3 years ago

Previous jenkins job ran Friday 1am, but the files tend to land in uploads (see anwc) on saturdays at 11pm. Schedule the ingest-dataset for Monday.

Adhoc job: http://aws-spark-quoll-master.ala:9194/job/Data-resource-loads/job/dr341-canb-anwc-weekly/

Notes: Source files on uploads: /mnt/data/anwc/upload/anwc/ Collectory points to: sftp://upload.ala.org.au:ala/dr341/Mapped-Archive.zip Scripts are all on /data/dmgt

sadeghim commented 2 years ago

Closing this as it has been completed a while ago.