Content Import: Failed connectors

[eliagbayani]

Failed connectors in Jenkins:

• GBIF country nodes -- (fixed, DwCA generated)
• (0891) NMNH type specimen data -- (fixed, DwCA generated) Zenodo
• BioImages: the Virtual Fieldguide (UK) -- (fixed, DwCA generated) Zenodo
• (0037) USDA Plants Images -- (fixed, DwCA generated) Zenodo

[eliagbayani]

Fix failed scheduled connectors for the six (6) GBIF country nodes (Germany, France, Netherlands, Brazil, Sweden, United Kingdom). Generated latest DwCA. Respective Zenodo records auto-updated.

GBIF data summaries: GBIF national node type records: UK - Zenodo 2024-09-19 {"MoF.tab":3222117, "occurrence.tab":472440, "taxon.tab":225818}

GBIF data summaries: GBIF national node type records: Sweden - Zenodo Thu 2024-09-19 {"MoF.tab":760582, "occurrence.tab":129106, "taxon.tab":63050}

GBIF data summaries: GBIF national node type records: Brazil - Zenodo Wed 2024-09-18 {"MoF.tab":1409077, "occurrence.tab":206180, "taxon.tab":72150}

GBIF data summaries: GBIF national node type records: Netherlands - Zenodo Wed 2024-09-18 {"MoF.tab":164148, "occurrence.tab":26382, "taxon.tab":16456}

GBIF data summaries: GBIF national node type records: France - Zenodo 2024-09-18{"MoF.tab":1941403, "occurrence.tab":278803, "taxon.tab":129331}

GBIF data summaries: GBIF national node type records: Germany - Zenodo 2024-09-18 {"MoF.tab":1909706, "occurrence.tab":279129, "taxon.tab":140307}

[eliagbayani]

BioImages: the Virtual Fieldguide (UK) Zenodo Fixed connector. Now generates the usual numbers we get. After two (Jan 2024, Jul 2024) updates with diminished numbers. Now we are seeing a good steady increase again.

2024-10-01 {"agent.tab":3, "media_resource.tab":147594, "taxon.tab":23241} 2024-07-01 {"agent.tab":2, "media_resource.tab":128655, "taxon.tab":7548} 2024-01-01 {"agent.tab":2, "media_resource.tab":128523, "taxon.tab":7534} 2023-12-19 {"agent.tab":3, "media_resource.tab":146605, "taxon.tab":23065} 2023-12-05 {"agent.tab":124, "media_resource.tab":146605, "taxon.tab":23041}

Logs

[eliagbayani]

National Museum of Natural History Type Data: NMNH type specimens Zenodo Finally fixed the connector that failed for quite some time now.

2024-10-02 {"MoF.tab":4396710, "occurrence.tab":363312, "taxon.tab":261298} 2024-01-12 {"MoF.tab":4389976, "occurrence.tab":362848, "taxon.tab":261136} 2023-12-12 {"MoF.tab":4385882, "occurrence.tab":362549, "taxon.tab":260999} 2023-11-12 {"MoF.tab":4385120, "occurrence.tab":362483, "taxon.tab":260976}

Logs

[eliagbayani]

(0037) USDA Plants Images Connector fixed, generated latest DwCA. Zenodo Not much change in numbers though. 2024-10-03 {"agent.tab":344, "media_resource.tab":20149, "taxon.tab":93911, "vernacular_name.tab":44135} 2024-06-11 {"agent.tab":344, "media_resource.tab":20147, "taxon.tab":93911, "vernacular_name.tab":44135} 2023-09-11 {"agent.tab":344, "media_resource.tab":20149, "taxon.tab":93911, "vernacular_name.tab":44135} Logs

[eliagbayani]

Failed connectors as of Oct 20, 2024.

[eliagbayani]

Wikimedia Commons failed during download stage.

A number of items to fix:

• wrong Language for File: vernacular_name.tab Line Value: es-419

• wrong agentRole for: File: agent.tab Line Value: |creator Line Value: |source

• missing media_resource tab in one of the steps

• filling-up missing parents should not trigger an update to Zenodo record if DwCA is not yet final. For Wikimedia and Wikipedia resources.

[jhammock]

Constant vigilance is needed with our upstream sources; yay for Jenkins! The NMNH, Bioimages, USDA Plants and GBIF node resource files all look good to me. It's interesting that the Pensoft resources have shifted out from under us, but I daresay that reflects a change in their services; I'd expect them to all be affected alike.