GSA / data.gov

Main repository for the data.gov service
https://data.gov
Other
594 stars 92 forks source link

Harvest error: Transformation to ISO failed #3959

Closed FuhuXia closed 1 year ago

FuhuXia commented 1 year ago

Received harvest job reports for https://catalog.data.gov/harvest/environmental-dataset-gateway-fgdc-csdgm, it contains 1383 errors with message "Transformation to ISO failed".

This harvest source was harvested fine in FCS with CKAN 2.8 before 08/01/2022, the day we took final FCS DB snapshot.

image

How to reproduce

https://catalog.data.gov/harvest/environmental-dataset-gateway-fgdc-csdgm

Expected behavior

Harvest successful

Actual behavior

Transformation to ISO failed

Sketch

[Notes or a checklist reflecting our understanding of the selected approach]

FuhuXia commented 1 year ago

DOT WAF source cant be updated due to this issue. https://catalog.data.gov/harvest/national-transportation-atlas-database-ntad-metadata

jbrown-xentity commented 1 year ago

This is a catch-all error I believe, this may need further investigation. There may be multiple reasons for these errors.

FuhuXia commented 1 year ago

For some harvest sources, it failed for all records with this error, such as DOT one. For other sources , it only failed for some records, such as this one https://catalog.data.gov/harvest/environmental-dataset-gateway-iso-geospatial-metadata.

nickumia-reisys commented 11 months ago

Fixed by