search

USGS-CMG / usgs-cmg-portal

do_convert.sh
6 stars 13 forks source link

Try visualizing COAWST with sci-wms #11

Closed rsignell-usgs closed 9 years ago

rsignell-usgs commented 10 years ago

Try visualizing the USGS COAWST model using SciWMS. COAWST is a ROMS-based model.

This is the DAP URL: http://geoport.whoi.edu/thredds/dodsC/coawst_4/use/fmrc/coawst_4_use_best.ncd

Using ncWMS/Govida2, it took 23 seconds to produce this snapshot of sea surface temperature:

8-25-2014 11-56-31 am

It will be interesting to see what the performance is like: 1) with SciWMS running remotely, accessing the data via the DAP URL 2) running SciWMS locally on the USGS machine where this data resides

rsignell-usgs commented 10 years ago

Tests suggest that sci-wms should be signficantly faster that ncWMS for this dataset: Extracting a layer via OPeNDAP and plotting with matplotlib using an IPython Notebook locally on the server where the data resides takes about 3 seconds, while the same test remotely on Wakari takes about 5.5 seconds

rsignell-usgs commented 9 years ago

@kknee, is sci-wms ready for me to test for this use case?

kknee commented 9 years ago

@rsignell-usgs we have not released an updated version yet @brianmckenna going to let you chime in on timeframe

kwilcox commented 9 years ago

I've got a "stable" sci-wms here that I've been using: https://github.com/kwilcox/sci-wms/commits/stable. This predates all of the changes ASA made for the Testbed project and inclues some bugfixes I had to make.

I've also refactored a bunch of things and pulled in all of @brandonmayer's "testbed" branch here: https://github.com/kwilcox/sci-wms/commits/refactor. Can we merge the "refactor" branch into ASA's master and get back to working on the same codebase? The "refactor" branch doesn't really work, but I'm not sure the "testbed" branch works either... I'd be happy to help get it to a "stable" release that includes the additional changes/functionality from the "testbed" branch.

Thoughts?

brianmckenna commented 9 years ago

I'll get a stable branch pushed this week, been working on the same.

rsignell-usgs commented 9 years ago

The last release of SciWMS was in August 2013! Yikes! https://github.com/asascience-open/sci-wms/releases

kwilcox commented 9 years ago

@brianmckenna @kknee @rsignell-usgs Any thoughts on merging my refactor branch so we can all get back onto the same page?

acrosby commented 9 years ago

@rsignell-usgs I may not have told anyone how I was producing releases with tags

brianmckenna commented 9 years ago

@kwilcox this still has all the model specific logic and doesn't seem to handle ROMS staggered grid (Arakawa C) which COAWST uses, with three real lon/lat variables, one derived (eg. lat_rho, lat_u, lat_v, lat_psi). None of these are identified (in their default ROMS form at least) by the 'lat'/'lon' variable expectation in original structured (cgrid) code. Is this branch considered functional for COAWST?

We have a solution being used and tested in the COMT project which currently handles ChesROMS datasets, unfortunately resources have being shifted to data management and UI so cleanup and release of sci-wms is behind.

I will attempt to rebase on your refactor branch, but presuming the autopep8, for one, will have a conflict with our updates. If that's the case I'll do my best to work backwards to find a common spot.

kwilcox commented 9 years ago

@brianmckenna Can you point me to the code that you guys are working off of? I can rebase my changes on top of that for you. You shouldn't have to do that!