search

ioos / registry

Getting data services registered in the IOOS Service Registry
http://ioos.github.io/registry/
2 stars 7 forks source link

Caricoos SWAN model granules need to be removed #58

Open rsignell-usgs opened 10 years ago

rsignell-usgs commented 10 years ago

@amilan17, I'm trying to eliminate all the bad DAP urls in the catalog, one group at a time. The UCAR and TAMU ones were huge!

So by perusing my list of good DAP urls and bad DAP urls it looks like next up for removal are 70+ bad Caricoos SWAN model granules like:

http://dm2.caricoos.org/thredds/dodsC/content/swan/201409281200.nc
http://dm2.caricoos.org/thredds/dodsC/content/swan/201409291200.nc

We don't need these because we have the Caricoos SWAN model aggregation in the catalog and it's working nicely:

http://dm2.caricoos.org/thredds/dodsC/swan/SWAN_Aggregation_best.ncd

(remember to put a URL on the end if you want to try these OPeNDAP data urls in your browser)

These datasets are coming from the harvest of this top level thredds catalog: http://dm2.caricoos.org/thredds/catalog.html seen here in the Collection Source: https://www.ngdc.noaa.gov/docucomp/collectionSource/show/7367749?layout=fluid

@jcapella or @jrodriguez-caricoos, is it necessary to harvest this top level catalog?
If it is necessary, could you remove the SWAN folder from this top level catalog and make it a separate catalog?
I could help with that if necessary.

amilan17 commented 10 years ago

Can you please tell me which services need to be removed and/or cleaned out? Thanks - anna

https://www.ngdc.noaa.gov/docucomp/collectionSource/list?max=10&serviceStatus=&recordSetId=3573894&search=List+Collection+Sources&layout=fluid&serviceType=&offset=20&serviceUrl=&componentId=

rsignell-usgs commented 10 years ago

@amilan17, I decribe the service in question here: https://github.com/ioos/registry/issues/58#issue-44830311 we need to find out from @jcapella or @jrodriguez-caricoos if removing this catalog will have other impacts.

jcapella commented 10 years ago

Will get back to you as soon as I'm back at the office, tomorrow.

On Mon, Oct 6, 2014 at 12:54 PM, Rich Signell notifications@github.com wrote:

@amilan17 https://github.com/amilan17, I decribe the service in question here:

58 (comment) https://github.com/ioos/registry/issues/58#issue-44830311

we need to find out from @jcapella https://github.com/jcapella or @jrodriguez-caricoos https://github.com/jrodriguez-caricoos if removing this catalog will have other impacts.

— Reply to this email directly or view it on GitHub https://github.com/ioos/registry/issues/58#issuecomment-58048883.

amilan17 commented 9 years ago

@jcapella @rsignell-usgs any followups on whether to perform a clean up or removal of this service: https://www.ngdc.noaa.gov/docucomp/collectionSource/show/7367749?layout=fluid

rsignell-usgs commented 9 years ago

It looks like one of @jcapella gang has cleaned up the top level catalog http://dm2.caricoos.org/thredds/catalog.html so that it points to separate catalogs now.

So definitely I would stop harvesting http://dm2.caricoos.org/thredds/catalog.html and remove all the datasets that were harvested from there.

jcapella commented 9 years ago

We are trying to get things in order. Are we now talking ROMS or SWAN?
ROMS was depurated and only r1 remains in public view , and should be aggregated. What's the problem with SWAN?

On 11/28/2014 8:22 AM, Rich Signell wrote:

It looks like one of @jcapella https://github.com/jcapella gang has cleaned up the top level catalog http://dm2.caricoos.org/thredds/catalog.html so that it points to separate catalogs now.

So definitely I would stop harvesting http://dm2.caricoos.org/thredds/catalog.html and remove all the datasets that were harvested from there.

— Reply to this email directly or view it on GitHub https://github.com/ioos/registry/issues/58#issuecomment-64888500.

rsignell-usgs commented 9 years ago

@jcapella, the problem isn't on your end anymore -- you have cleaned things up nicely. @amilan17 just has to clean up the metadata catalog as it still has all those SWAN daily datasets that were replaced by your SWAN aggregation.

amilan17 commented 9 years ago

@rsignell-usgs @jcapella Changed status in collectionSource table to "For Removal'. http://www.ngdc.noaa.gov/docucomp/collectionSource/show/7367749

amilan17 commented 9 years ago

@rsignell-usgs @jcapella The granules have been cleaned up. There is now only ONE record in the CariCOOS WAF. http://www.ngdc.noaa.gov/metadata/published/NOAA/IOOS/CariCOOS/iso/

jcapella commented 9 years ago 
Thanks Anna and Rich.

On 12/2/2014 12:51 PM, Anna Milan
  wrote:

  @rsignell-usgs
    @jcapella 
    The granules have been cleaned up. There is now only ONE record
    in the CariCOOS WAF. 
    http://www.ngdc.noaa.gov/metadata/published/NOAA/IOOS/CariCOOS/iso/
  —
    Reply to this email directly or view
      it on GitHub.