search

asascience / ott-coops

Project Tracking for OTT Co-Ops
1 stars 0 forks source link

Create Residual Error Plot to More Clearly Display Trends in Forecast Error #13

Open jamesdoyle21 opened 3 years ago

jamesdoyle21 commented 3 years ago

Google Sheet Row Number: 13, 79, 80, 81, 15 (Offshore Wind)

Want to be able to: use the NWPS waves and NDFD winds data So that he can: take a holistic look at the wind and waves and compare data to the few wave bouys in the bay

Want to be able to: When viewing model vs. observed Time Series Line Plot, plot difference in separate graph underneath So that he can: More clearly see the trend in forecast error

Does Oceans Map already have this functionality?: Yes(?) Located where in OM?: "Sounds like the data validation tool. Agreed, changed the epic to Model QA [KK] I think even the TS tool on the map may solve some of this "

Notes: This is another way to visualize the difference between predicted and actual. "Looking to achieve what? Compare forecasts to observations More accurate forecast? Yes"

Make sure we plot forecasted vs observed and also plot difference below it. Very similar to what pilots asked for with Waterline

jamesdoyle21 commented 3 years ago

JH - Oceans map does not have this capability. We need a map-based view of model bias, probably using color-coded symbols at each validation station. This is really important for making the validation tool understandable and more useable. I have suggestions for this.

jamesdoyle21 commented 3 years ago

JH - So rather than absolute model error, we would report error relative to preset user tolerances. This is how NOAA does their internal WL validations. This is where a green-yellow-red error map would be useful. The color shows how far the results is outside of the tolerance limits....

jamesdoyle21 commented 3 years ago

JH - There are a lot of ways to display model bias. It is an important decision making parameter. We need both time series and map-based views.