search

AtlasOfLivingAustralia / data-management

Data management issue tracking
7 stars 0 forks source link

Data load fix: Australian Museum #598

Open peggynewman opened 4 years ago

peggynewman commented 4 years ago

Starting with : https://support.ehelp.edu.au/a/tickets/83839 check to see if the URL change for AM will impact the data load.

Also in the upload server there are 4 new monthly files which don't seem to have been loaded. Ensure the jenkins job to load AM data is set up correctly to pick up these files.

patkyn commented 4 years ago

Looking at the record providers for AM,

I'm assuming that the a monthly job needs to be setup for this? https://collections.ala.org.au/dataResource/show/dr340 How about the following drs? Database of Australasian Vertebrate Occurrences (resource) - (via the institution) Fossil Birds (resource) - (via the institution) Fossil Fish (resource) - (via the institution) Lizard Island Research Station (resource) - (via the institution)

Some of the expedition drs seem to be setup to harvest from digivol. Though I don't think it is working at the moment.

ansell commented 4 years ago

Fixing the Lizard Island Research Station data load is being tracked in #579 . It was using a direct download of a CSV file, but that URL is unavailable now.

patkyn commented 4 years ago

It seems that the rest of the following drs are manually uploaded at the moment: Database of Australasian Vertebrate Occurrences (resource) - (via the institution) Fossil Birds (resource) - (via the institution) Fossil Fish (resource) - (via the institution)

patkyn commented 4 years ago

Setup monthly job to load dr340 which is scheduled to run 28th every month. There were 1,541,682 records for Data resource: Australian Museum provider for OZCAM before load. Ran the job to pickup April load

patkyn commented 4 years ago

Completed loading May and June load