search

USGS-CMG / usgs-cmg-portal

do_convert.sh
6 stars 13 forks source link

automate loading WMS endpoints from CSW #229

Closed rsignell-usgs closed 7 years ago

rsignell-usgs commented 7 years ago

We now have a handful of WMS layers in our catalog, and we would like to get the automated loading of WMS endpoints from CSW into the Portal working.

Luckily, @kwilcox says it should only take a couple of days: https://github.com/USGS-CMG/usgs-cmg-portal/issues/176#issuecomment-248342073 :smiley_cat:

kwilcox commented 7 years ago

yup, @shane-axiom made some changes I needed months ago and I just need to get around to harvesting the WMS servers.

rsignell-usgs commented 7 years ago

Oh, I forgot one very important thing.

Our CSW endpoint has changed from http://geoport.whoi.edu/csw to http://gamone.whoi.edu/csw at least for a few months.

This is because geoport is a CNAME that currently points to gam.whoi.edu, and gamone.whoi.edu is a machine that will replace gam.whoi.edu, using mostly docker containers. We are not quite ready to switch the CNAME, but we are ready to start using the pycsw service on gamone.whoi.edu (in fact, the one on gam.whoi.edu=geoport.whoi.edu is no longer working).

zdefne-usgs commented 7 years ago

Hi @kwilcox, Is there any chance we can demonstrate these layers on the portal at our project meeting next week? We will have our program manager, regional director and science advisor attending the meeting. It would make good showcase for the direction we are heading.

rsignell-usgs commented 7 years ago

@kwilcox , this would be HUGE! :stuck_out_tongue_winking_eye: The Wetlands Synthesis Update Meeting is at 3pm wednesday.

kwilcox commented 7 years ago

@rsignell-usgs The WMS datasets aren't coming through with the correct reference scheme:

The schemes will need to be <dct:references scheme="OGC:WMS"> like they are for the models. Can you update these easily?

kwilcox commented 7 years ago

Nevermind, I see a single OGC:WMS in there now that I formatted it better...

zdefne-usgs commented 7 years ago

@rsignell-usgs I have uploaded two more GIS metadata under gis_usgs_cmg folder. @kwilcox Any chance that the magic button to ingest them to the Portal is ready to push? :) Thanks!

rsignell-usgs commented 7 years ago

Unfortunately due to unresolved issues with ScienceBase WMS, the automated loading of GIS layers from our CSW catalog is not working yet.

Is that about right, @kwilcox ?

kwilcox commented 7 years ago

Sort of. I'm manually adding them.

More to come...

nganju-usgs commented 7 years ago

typo there, "salt marsh" not "salt march"

kwilcox commented 7 years ago

Thanks @nganju-usgs, fixing.

Here is another: http://cmgdata.usgsportals.net/#module-metadata/a102697a-cb54-4da6-b4fd-9875061a1696/59a8a01b-9ef1-428b-95bb-75a4862f4efa

The ScienceBase WMS servers are periodically not responding so if you don't get an image try again in a few minutes.

kwilcox commented 7 years ago

Update: ScienceBase is still referencing a location that doesn't exist in its WMS GetCapabilities documents: https://www.sciencebase.gov:443/catalogMaps/schemas/wms/1.1.1/WMS_MS_Capabilities.dtd. Without the GetCapabilities documents being functional these ScienceBase datasets won't be able to be updated/added over CSW and will have to be manually added.