ladybug-tools / epwmap

⛅️ map of available .epw weather files
http://ladybug-tools.github.io/epwmap/
MIT License
33 stars 18 forks source link

Add weather files from onebuilding.com #9

Closed mostaphaRoudsari closed 7 years ago

mostaphaRoudsari commented 9 years ago

I'm so excited for this one. New weather files that are double checked and also will get updated, available for free! What could be better than this?

Announcing...
http://climate.onebuilding.org

A new site for EPW file availability.

Why Should I download Climate Data Files from Climate.OneBuilding?

2013 Design Condtions from ASHRAE Fundamentals Handbook
New Weather Data Sets that You Can't Get from EnergyPlus web site
Frequently Updated as New Weather Data Sets and Design 
Conditions are Released
Consistent naming and locations validated:
Washington, DC 
vs USA_VA_Arlington-Ronald.Reagan.Washington. National.AP
Coming soon (See the news page for plans and current status):
Select locations from maps (or text/table as now)
Statistics and graphics
And lots more stuff...

Thanks to Gard and onebuilding for hosting this site.
There will be no charges for data on this site.
mostaphaRoudsari commented 9 years ago

One more here, and god, the font on the site made me re-evaluate my definition of selecting fonts! how can you do that with yourself!

Revision of TMY3 Weather Files

White Box Technologies (WBT), in collaboration with the National Renewable Energy Laboratory (NREL), has revised the TMY3 weather files to correct inconsistencies in units for illuminances, improve the reporting of Liquid Precipitation, replace all missing records with interpolated or filled values (chiefly for visibility, ceiling height, aerosol optical depth, and albedo), and add a new variable for Present Weather.

Since their release in 2005, the TMY3 weather files covering 1,020 locations in the US and dependencies has become the standard set of weather files for use in computer simulations of solar energy conversion systems and buildings. For more information about the TMY3 data set, please go to http://rredc.nrel.gov/solar/old_data/nsrdb/1991-2005/tmy3.

The intent of this revision is not to redo the fundamental analysis, but to correct some known errors and make modest improvements in the reporting of subsidiary climate variables. The only changes affecting building energy simulations are those for Illuminance (used in daylighting programs such as Radiance), and Liquid Precipitation (used in EnergyPlus to model green roofs, and other programs that model moisture migration in building envelope). Filling in missing data for Visibility, Ceiling Height, etc., should have no effect on any known simulation program, but makes the TMY3 files more usable for further analysis.

Explanation of changes in content:

1) Illuminance. The TMY3s contain values for Global Horizontal, Direct Normal, Diffuse Horizontal, and Zenith Illuminance that are calculated based on the sun position and solar radiation. Although the documentation states that the units are 100 lux for the first three illuminances, and 10 candela/m2 for the Zenith Illuminance, all the TMY3 files used these units only for the period Jan. 2-31, and for the rest of the year used units of lux and candela/m2, respectively. NREL put out a notice in August 2008 (see the link listed earlier) informing users of this discrepancy and promising a corrected version that didn't make it out until now! In this revision, we've decided to keep the units in the original TMY3 documentation, i.e., 100 lux or 10 candela/m2, which is the same as what was in the TMY2, and avoids the superfluous five-digit precision.

2) Liquid Precipitation. The TMY3s are the first set of TMY files to contain Liquid Precipitation (rainfall). In the original TMY3 files, rainfall was taken directly from weather station reports with two numbers, one for the amount and the other for the duration in hours of the rainfall. The difficulties moving this reporting to hourly weather files are: (1) the rainfall needs to be apportioned to hourly values, and (2) there can be multiple or overlapping records that were ignored. Furthermore, by changing the precipitation units from 0.1mm to 1mm, the TMY3s contained significant round-off errors. In this revision, WBT went back to the raw weather reports from the National Climatic Data Center (NCDC) and applied a procedure developed for ASHRAE RP-1477 that checks for multiple records as well as disaggregate the rainfall to hourly values. To winnow out spurious reports, filters were added to limit the maximum amount of rainfall per hour, and to omit it if the dewpoint temperature dropped below freezing. Overall, the revised rainfall correlated much better to historical averages, although there probably remains significant undercounting in a number of locations. For example, 23 locations out of the 1,020 (2.3%) reported no rainfall throughout the year (see www.whiteboxtechnologies/download_TMY3_liqprec_rpt.htm for a more thorough discussion).

3) Filling in missing values. One of the main reasons to use processed weather files like TMY3s is the absence of missing records, as often found in raw weather data. Thus, it was surprising that the original TMY3s contained a lot of missing data, albeit almost all for secondary variables like Liquid Precipitation, Visibility, Ceiling Height, calculated variables like Aerosol Optical Depth and Albedo, and on one file (Mountain View CA) Wind Direction. Although none of these instances will likely cause problems for simulations, in the spirit of completeness all of them have been filled using either linear interpolation for continuous values (Visibility, Ceiling Height, etc.) or a step function for discrete values (Wind Direction).

4) Present Weather. This variable is a qualitative description of weather conditions, e.g., clear, rain, snow, etc., generally recorded using a numerical code. Although the TMY3s do not contain this variable, the previous TMY2s did using a 10-digit numerical code. Although Present Weather is not used directly in any calculations, it's a useful variable to corroborate other variables for precipitation, cloud cover, etc. For example, in revising the Liquid Precipitation described earlier, Present Weather was used to decide whether or not reported heavy rainfall was bogus. In this revision, an extra field has been added to the end of each line with the international METAR 2-digit code for Present Weather (please see Appendix C of the ASHRAE RP-1477 final report for coding).

Explanation of changes in format

The canonical form of the TMY3 files are in the *.CSV format. Since the illuminance data revert back to the units in the TMY3 documentation, there are only two minor changes in the TMY3.CSV format: (1) unit for Liquid precipitation depth (Variable 65) is changed from 1mm to 0.1mm, (2) a 2-digit number for Present Weather has been added at the end of each line as Variable 69. For those familiar with ASHRAE's IWEC2 files, with these changes the data line format of the two types of files are now exactly the same, although the header line formats remain slightly different.
Conversion of the revised TMY3.CSV files to TMY2 or EPW should not be a problem, as long as the change in units for Liquid Precipitation has been noted, and the illuminance units are those in the original TMY3 documentation. Conversion of the revised TMY3.CSV files to BINM is unnecessary since the BINM files do not include any of the changed variables.

The updated TMY3 files are available on the NREL TMY3 web site at http://rredc.nrel.gov/solar/old_data/nsrdb/1991-2005/tmy3. The revised files are labeled as *TYA.CSV to distinguish them from the previous *TY.CSV files, which will remain on the Web site for another month before being taken down.

The updated TMY3 files in EPW and BINM formats are available on the WBT Weather web site at http://weather.whiteboxtechnologies.com/wd-TMY3 or by selecting File Type "TMY3" at http://weather.whiteboxtechnologies.com/search. The zip file names are unchanged, but the underlying EPW and DDY files are labelled as *TYA.epw, etc., to distinguish them from the previous versions.

Supplemental data of interest to EnergyPlus users

In addition to the weather file, EnergyPlus also needs a *.DDY file that's typically taken from a data base of design conditions in the ASHRAE Handbook of Fundamentals (HOF). With the proliferating availability of weather files, there are times when a location is not listed in the HOF and the attached DDY file is blank, as is the case for 57 of the 1,020 TMY3 locations. Since WBT has weather files for thousands of stations going back to 2001, this allowed us to calculate the design conditions for all 1,020 TMY3 files following the ASHRAE design day procedures. To avoid confusion with the DDY files based on the HOF, these new design files are given the *.DDY2 extension. For the 57 locations, this will provide DDY files needed for EnergyPlus sizing calculations. For the remaining 955 stations, the DDY2 files provide an alternate set of design conditions based on more recent data.

If you find anything unusual in the TMY3A or TMY3, please let us know!

Such a large data set makes it impossible to visually inspect all 90 million elements (8.935 million x 10 elements per hour). In most instances, anomalies or quirks become apparent only upon use. If anyone finds anything that seems puzzling or unreasonable, please bring it to our attention. We’re not promising we’ll fix everything, but it’s very useful for identifying glitches which we can then avoid by adding software filters and barriers.

Joe Huang Manajit Sengupta
White Box Technologies National Renewable Energy Laboratory
Moraga, CA Golden, CO

Jan 14, 2015

Joe Huang
White Box Technologies, Inc.
346 Rheem Blvd., Suite 205A
Moraga CA 94556
yjhuang@whiteboxtechnologies.com
http://weather.whiteboxtechnologies.com for simulation-ready weather data
(o) (925)388-0265
(c) (510)928-2683
"building energy simulations at your fingertips"
mostaphaRoudsari commented 9 years ago

http://rredc.nrel.gov/solar/old_data/nsrdb/1991-2005/tmy3/

mostaphaRoudsari commented 9 years ago

I implemented all we need to add new data from other resources other then DOE. Waiting for Dru and Linda on this one.