search

ioos / ckanext-ioos-theme

IOOS Catalog as a CKAN extension
GNU Affero General Public License v3.0
7 stars 14 forks source link

Add USGS WAFs/datasets #129

Closed mwengren closed 6 years ago

mwengren commented 7 years ago

Currently we're missing any USGS datasets.

mwengren commented 6 years ago

Registered the OBIS-USA CS-W endpoint provided by USGS: https://www.sciencebase.gov/catalog/item/579b64c6e4b0589fa1c98118/csw.

Issues apparent with CS-W harvester as it isn't terminating properly and continually adding records.

WAF created successfully however with finite number of records: https://registry.ioos.us/waf/USGS/.

mwengren commented 6 years ago

The USGS CS-W harvest in the Registry looks to be working now. But, for some reason, we have 2x the datasets in the Catalog under the USGS Org. Although the Catalog harvest task shows the correct 104 amount.

I think this may be due to the 103 records we originally harvested not clearing properly. @benjwadams can you look into this? Probably just doing a clear and reharvest in CKAN will fix it.

benjwadams commented 6 years ago

Yeah, I cleared out the old records yesterday and ran a reharvest, so the USGS records on Registry as well as Catalog should all be at 104. Going to close as the number of records now matches.