weecology / bbs-forecasting

Research on forecasting using Breeding Bird Survey data
MIT License
7 stars 9 forks source link

Get data on climate forecasts #14

Closed ethanwhite closed 7 years ago

ethanwhite commented 8 years ago

To start making actual forecasts using models that involved exogenous variables, we will need forecasts for those variables. This issue is a place for us to start looking into options for doing this.

sdtaylor commented 8 years ago

There is so much information on climate/weather predictions available. There are many different groups, a lot of them doing things that overlap, a lot specializing on specific regions or processes, a lot summarizing/ensembling what other have done. etc.

It would be really beneficial if we could get a crash course in climate modelling. How they are made, what their predictions actually comprise and what they can and can't be used for.

That being said, here are two links within NOAA that we'll probably end up pulling data from some day.

NOAA Model Datasets - Lots of datasets from various weather/climate models. Some of them are especially interesting because that have historic forecasts which can be judged against what actually happened.

NCEP EMC -

National Centers For Environmental Prediction's Environmental Modeling Center. The Environmental Modeling Center is responsible for the enhancements, transitions-to-operations, and maintenance of more than 20 numerical prediction systems comprising NCEP's operational production suite.

sdtaylor commented 8 years ago

This R package will probably be useful for this. It's a wrapper for accessing the API of a bunch of NOAA data.

https://github.com/ropensci/rnoaa

sdtaylor commented 8 years ago

Short Term Forecasts (1-20 days)

Global Ensemble Forecast Systems (GEFS) Ensemble forecast of 21 different global models. Resolution of 1-2.5 deg. Released 4 times daily, each one making forecasts for 0-16 days ahead at 6 hour timesteps. Has confidence intervals.

Global Forecast System (GFS) Single model global forecasts. 0.5 or 1 deg. released 4 times daily, making forecasts at 3 hour timesteps out to 10 days, and 12 timesteps 10-16 days. Past a few hours it does not have forecasts for on the ground variables (temp & precip) directly. NWS home page for GFS http://www.emc.ncep.noaa.gov/index.php?branch=GFS

Experimental Forecast with Confidence Intervals This group at FSU is using GFS ensembles to make confidence intervals of short term forecasts (up to 7 days out). Doesn't look like they make data available.

Long term forecasts (20 days - 1 year)

CFSv2 Operational Forecasts with CI's 0.5 deg global forecasts, released 4 times daily. hourly timesteps out to 9 months NWS uses of the CFFv2 here - http://www.cpc.ncep.noaa.gov/products/CFSv2/CFSv2seasonal.shtml

Abatzogula Lab downscaled 7 month forecast Uses the North American Ensemble project do create downscaled (4km) grid of the western us daily precip and temp forecasts up to 7 months out. Really nice visuals and website tools. Also looks like easy access to actual data.

NWS Climate Prediction Center three month outlooks. forecasts 3 month mean temp & total precip for up to 12.5 months into the future. old old old website. There is little actual data to download, just 90's era maps. There is "GIS data", but it's only shapefiles showing the probability of exceeding the long term average, and doesn't seem to even match the old school maps.

European Centre for Medium-Range Weather Forecasts Hosts many different forecast datasets with global coverage from several days to 7 months out. Includes ensemble forecasts. Some data is free without a login, some available for research use only with a possible small fee.

International Research Institude for Climate & Society Based at columbia univ. Hosts a lot of climate data in a very confusing website. Most of the NOAA forecast data is hosted here.

APCC Climate Center Asian Pacific Partnership of 21 countries (including USA) consolidates other climate forecasts and makes an ensemble. Data page here

Very Long Term Forecasts (Decadal forecasts, 1-30 years)
CMIP5 - need to create account and agree to educational data use license (essentially just need to cite it). CMIP5 is a collection of global climate models from various institutions around the world. They are used for the different IPCC scenarios and it's very common to see them in studies. This paper used CMIP5 data and it looks like it has at least yearly resolution out to several decades. CMIP data looks like a beast but here is a tutorial

UK Met Office Decadal Forecasts Making forecasts for 1-5 years into the future (the temporal average over that period) with what looks like a 1-2 deg global grid. Does not look like data is directly available for download.

Decadal Climate Prediction: An Update from the Trenches - 2014 Paper about the state of the field in decadal forecasts, still a relatively new idea.

ethanwhite commented 7 years ago

Done using CMIP5 so closing for now. Definitely interested in the shorter term data forecasting efforts.