search

ioos / registry

Getting data services registered in the IOOS Service Registry
http://ioos.github.io/registry/
2 stars 7 forks source link

SOS MARACOOS WAF Cleanout #73

Closed lukecampbell closed 9 years ago

lukecampbell commented 9 years ago

Hey Folks,

Could I get a clean out for the MARACOOS WAF at http://sos.maracoos.org/maracoos-iso/

The WAF was regenerated today, a lot of the data have been moved and or renamed.

amilan17 commented 9 years ago

yes - check back again tomorrow to ensure that all is as expected...

lukecampbell commented 9 years ago

@amilan17 Could you do a cleanout one more time? The last set of ISOs didn't have any of the OPeNDAP URLs, and I still can't identify how or why that happened so I ran NcISO from a remote machine to generate all the ISOs this time, and verified that the OPeNDAP URLs are there.

<srv:containsOperations>
  <srv:SV_OperationMetadata>
    <srv:operationName>
      <gco:CharacterString>OPeNDAP Client Access</gco:CharacterString>
    </srv:operationName>
    <srv:DCP gco:nilReason="unknown"/>
    <srv:connectPoint>
      <gmd:CI_OnlineResource>
        <gmd:linkage>
          <gmd:URL>
            http://sos.maracoos.org/stable/dodsC/hrecos/stationHRALBPH-agg.ncml
          </gmd:URL>
amilan17 commented 9 years ago

Ok - I'll keep the configurations for clean out of MARACOOS until I have confirmation from you that it is all good. Check back again tomorrow (Thurs).

Anna ~~~~~~~ Anna.Milan@noaa.gov, 303-497-5099 Metadata Specialist

NOAA National Centers for Environmental Information formerly NOAA’s National Geophysical Data Center

http://www.ngdc.noaa.gov/metadata/emma ~~~~~~~

On Wed, Apr 29, 2015 at 9:10 AM, Luke Campbell notifications@github.com wrote:

@amilan17 https://github.com/amilan17 Could you do a cleanout one more time? The last set of ISOs didn't have any of the OPeNDAP URLs, and I still can't identify how or why that happened so I ran NcISO from a remote machine to generate all the ISOs this time, and verified that the OPeNDAP URLs are there.

srv:containsOperations srv:SV_OperationMetadata srv:operationName gco:CharacterStringOPeNDAP Client Access/gco:CharacterString /srv:operationName

srv:connectPoint
  gmd:CI_OnlineResource
    gmd:linkage
      gmd:URL
        http://sos.maracoos.org/stable/dodsC/hrecos/stationHRALBPH-agg.ncml
      /gmd:URL

— Reply to this email directly or view it on GitHub https://github.com/ioos/registry/issues/73#issuecomment-97460115.

lukecampbell commented 9 years ago

Thank you!

brianmckenna commented 9 years ago

@amilan17 looks like it has been cleared out successfully, can you remove the 'configurations for clean out'? We should be all set to with the records to be recreated. Please let me know if we need to re-register each. Thank you!

robragsdale commented 9 years ago

@amilan17 The production WAF is populated, the test WAF is empty. Does MARACOOS need to repopulated their WAF? The catalog is showing 0 services and datasets right now and we need to resolve this as quickly as possible. Thanks!

amilan17 commented 9 years ago

looking into it right now.

Anna ~~~~~~~ Anna.Milan@noaa.gov, 303-497-5099 Metadata Specialist

NOAA National Centers for Environmental Information formerly NOAA’s National Geophysical Data Center

http://www.ngdc.noaa.gov/metadata/emma ~~~~~~~

On Tue, May 5, 2015 at 2:31 PM, robragsdale notifications@github.com wrote:

@amilan17 https://github.com/amilan17 The production WAF http://www.ngdc.noaa.gov/metadata/published/NOAA/IOOS/MARACOOS/iso_u/ is populated, the test WAF http://www.ngdc.noaa.gov/metadata/published/test/NOAA/IOOS/MARACOOS/iso_u/ is empty. Does MARACOOS need to repopulated their WAF? The catalog is showing 0 services and datasets right now and we need to resolve this as quickly as possible. Thanks!

— Reply to this email directly or view it on GitHub https://github.com/ioos/registry/issues/73#issuecomment-99211909.

amilan17 commented 9 years ago

@robragsdale @lukecampbell @brianmckenna

So it seems that for some reason EMMA did not complete the processing of MARACOOS last night/this morning. I re-ran processing and re-synced 440 records to production WAF ( http://www.ngdc.noaa.gov/metadata/published/NOAA/IOOS/MARACOOS/iso/) and Geoportal. I don't know what caused this issue, but I also turned off the cleanout configurations of the previous run so all records won't disappear again, but we should remember to be vigilant when we need to do another clean out of records. On a different, but most likely related note:

It looks like the sos maracoos WAF contains all the records (or more) associated with the previously registered services.

Are you trying to replace these previous services with the metadata published in this WAF?

robragsdale commented 9 years ago

@brianmckenna @lukecampbell The MARACOOS services are not being represented right now in the Catalog. @amilan17 is working on this.

We need for you to clarify for us if you want to replace the service URLs registered in the registry now with this new WAF URL http://sos.maracoos.org/maracoos-iso/?

We will need to register this new WAF in the registry.

Thanks.

brianmckenna commented 9 years ago

@robragsdale @amilan17 I'll be providing the list shortly for clarity. Quickly cleaning out a few dead links in there.

We will need to register that new WAF and keep the existing THREDDS service URLs, I will provide those links as well, so there's no confusion

brianmckenna commented 9 years ago

@amilan17

Lets just go with the new WAF. Replaces the old entries. So...

URL Point of Contact Organization
http://sos.maracoos.org/maracoos-iso/ Brian McKenna - RPS ASA - bmckenna@asascience.com MARACOOS

Thanks for this.

robragsdale commented 9 years ago

@brianmckenna there are 22 records in the NGDC Geoportal now for MARACOOS. It looks like these services are duplicated in the WAF. @amilan17 Do we need to remove these records from Geoportal so we don't have duplication?

brianmckenna commented 9 years ago

@robragsdale correct, please remove those 22 existing records. thank you

amilan17 commented 9 years ago

@brianmckenna

Great! Thanks. This WAF is now submitted: https://www.ngdc.noaa.gov/docucomp/collectionSource/list?recordSetId=2604646&componentId=&serviceType=&serviceStatus=SUBMITTED&serviceUrl=&search=List+Collection+Sources if all goes well we will see all of these metadata records in the test MARACOOS waf in EMMA http://www.ngdc.noaa.gov/metadata/published/test/NOAA/IOOS/MARACOOS/iso_u/

THEN, we will change the status to approved AND set the status of all these other services to 'for removal'

https://www.ngdc.noaa.gov/docucomp/collectionSource/list?recordSetId=2604646&search=List+Collection+Sources&serviceStatus=APPROVED&serviceType=&serviceUrl=&componentId=&max=20

robragsdale commented 9 years ago

@brianmckenna has the contact information for the services in the WAF that are replacing the older services been updated and checked that information is not being lost?