rs1729 / RS

radiosonde decoding
GNU General Public License v3.0
170 stars 56 forks source link

radiosonde launch sites #15

Open rs1729 opened 5 years ago

rs1729 commented 5 years ago

The WMO code are in the common code tables http://www.wmo.int/pages/prog/www/WMOCodes/WMO306_vI2/LatestVERSION/LatestVERSION.html

2018 Jun: station: sonde_type(s) # lat lon all_stat_2018jun.txt

world2018jun 89009: 23 # -90.00 0.00

Some stations not reporting to http://weather.uwyo.edu/upperair/sounding.html (e.g. Uccle: RS41-SGP+O3) Cuba and Spain not reporting, and Finland, home of RS92/RS41?

rs1729 commented 5 years ago

2019 Jun: station: sonde_type(s) # lat lon all_stat_2019jun.txt

world2019jun 89009: 23 # -90.00 0.00

France not reporting anymore? More iMS-100 in Turkey, but less in Mexico.

darksidelemm commented 5 years ago

This is very cool data. I might look at making a little webpage to visualise it so people can go look up info on what launch sites are near them.

rs1729 commented 5 years ago

Yes, a webpage where you can zoom in and have additional infos would be nice. Unfortunately not all stations report to the database that is available e.g. at http://weather.uwyo.edu/upperair/sounding.html Though missing data for some stations (France, Spain, Finland, ...) could be added through data on tracker.sondehub.org

darksidelemm commented 5 years ago

Where did you get the list of launch site codes and their associated radiosonde codes?

rs1729 commented 5 years ago

sounding data: http://weather.uwyo.edu/upperair/sounding.html LIST data has station information, RAW has launch time and radiosonde wmo code e.g. RAW data for station 94672, 2019/06: http://weather.uwyo.edu/cgi-bin/sounding?TYPE=TEXT%3ARAW&YEAR=2019&MONTH=06&FROM=all&STNM=94672 (if you choose date/time for which there is no data for a existing station, you get the station name)

raw data is explained here https://www.fingers-welt.de/phpBB/viewtopic.php?f=14&t=43&start=1425#p122972 http://www.uni-koeln.de/math-nat-fak/geomet/meteo/winfos/radiosonden/Europa/temp_frame.html also here http://radiosonde.eu/RS00-D/RS05Q-D.html (didn't find english version)

station list: I took a igra-station list; just found a new version: https://www1.ncdc.noaa.gov/pub/data/igra/ also have an older list and this metar-station list: https://www.aviationweather.gov/docs/metar/stations.txt Missing stations can also be found here, e.g.: https://weather.gladstonefamily.net/site/06011 https://weather.gladstonefamily.net/site/94672

my current igra-list: igra-stations2.txt

Coordinates differ sometimes, some stations have several or changing station numbers or different launch sites, resp.

The WMO radiosonde codes can sometimes be wrong when (entered manually, I guess). And you never know if they use older WMO codes from http://www.wmo.int/pages/prog/www/WMOCodes/WMO306_vI2/LatestVERSION/LatestVERSION.html

The latest station_radiosonde_list 2019/06 (w/ station-altitude) station: sonde_type(s) # lat lon alt stations_2019jun2.txt (update) (added some stations in France and Finland and missing stations in other countries) update: some more stations from the new igra-list. and I found at least one station that I didn't have in the known-stations-list for the RAW-http-requests. I made the list in 2015, maybe it needs an update.

rs1729 commented 4 years ago

http://www.raob.com/data_sources.php here you can find another useful data base: http://www.ogimet.com/sond.phtml.en The "query by country page" e.g. shows also some the stations in France, Spain, Finland. http://www.ogimet.com/display_sondc.php?lang=en&estado=France&tipo=ALL&ord=DIR&nil=SI&fmt=txt&ano=2019&mes=06&day=01&hora=00&anof=2019&mesf=06&dayf=30&horaf=23&send=send There you have the station name and coordinates already in the data and it is easier to get an overview, only need a list of countries. I also see mil stations like Meppen and Altenstadt in Germany (didn't find them at uwyo), although Uccle/Belgium (RS41-O3 3x/week) is still missing, and probably some others like test stations.

UPDATE: Even better, you only need a list of characters A-Z (don't know if it is possible to select all or use wildcards): A: http://www.ogimet.com/display_sondc.php?lang=en&estado=A&tipo=ALL&ord=DIR&nil=SI&fmt=txt&ano=2019&mes=06&day=01&hora=00&anof=2019&mesf=06&dayf=30&horaf=23&send=send

11010, Linz / Hoersching-Flughafen (Austria) | 48-14N | 014-11E | 298 m 11035, Wien / Hohe Warte (Austria) | 48-15N | 016-22E | 203 m 11120, Innsbruck-Flughafen (Austria) | 47-16N | 011-21E | 581 m 11240, Graz-Thalerhof-Flughafen (Austria) | 47-00N | 015-26E | 340 m 37789, Yerevan (Armenia) | 40-08N | 044-28E | 890 m 40948, Kabul Airport (Afghanistan) | 34-38N | 069-12E | 1789 m 60390, Dar-El-Beida (Algeria) | 36-43N | 003-15E | 25 m 60549, Mecheria (Algeria) | 34-56N | 000-26W | 1149 m 60571, Bechar (Algeria) | 31-37N | 002-14W | 773 m 60630, In Salah (Algeria) | 27-12N | 002-28E | 293 m 60656, Tindouf (Algeria) | 27-40N | 008-08W | 431 m 60680, Tamanrasset (Algeria) | 22-47N | 005-31E | 1378 m 78861, Coolidge Field, Antigua Aux. Afb (Antigua and Barbuda) | 17-07N | 061-47W | 22 m 87047, Salta Aerodrome (Argentina) | 24-51S | 065-29W | 1238 m 87155, Resistencia Aero. (Argentina) | 27-27S | 059-03W | 53 m 87344, Cordoba Aerodrome (Argentina) | 31-19S | 064-13W | 484 m 87418, Mendoza Aerodrome (Argentina) | 32-50S | 068-47W | 705 m 87576, Ezeiza Aerodrome (Argentina) | 34-49S | 058-32W | 20 m 87623, Santa Rosa Aerodrome (Argentina) | 36-34S | 064-16W | 190 m 87715, Neuquen Aerodrome (Argentina) | 38-57S | 068-08W | 270 m 87860, Comodoro Rivadavia Aerodrome (Argentina) | 45-47S | 067-30W | 58 m 89002, Neumayer (Antarctica) | 70-40S | 008-15W | 50 m 89055, Base Marambio Centro Met. Antartico (Antarctica) | 64-14S | 056-43W | 198 m 89062, Rothera Point (Antarctica) | 67-34S | 068-08W | 16 m 89532, Syowa (Antarctica) | 69-00S | 039-35E | 18 m 89564, Mawson (Antarctica) | 67-36S | 062-52E | 10 m 89571, Davis (Antarctica) | 68-35S | 077-58E | 18 m 89611, Casey (Antarctica) | 66-17S | 110-31E | 40 m 89625, Concordia (Antarctica) | 75-06S | 123-24E | 3232 m 89642, Dumont D'Urville (Antarctica) | 66-40S | 140-01E | 41 m 89662, Base Baia Terra Nova (Antarctica) | 74-42S | 164-06E | 80 m 94120, Darwin Airport (Australia) | 12-24S | 130-52E | 31 m 94150, Gove Airport (Australia) | 12-16S | 136-49E | 52 m 94170, Weipa Amo (Australia) | 12-41S | 141-55E | 20 m 94203, Broome Airport (Australia) | 17-57S | 122-13E | 17 m 94238, Tennant Creek Airport (Australia) | 19-38S | 134-10E | 375 m 94294, Townsville Amo (Australia) | 19-15S | 146-45E | 6 m 94299, Willis Island (Australia) | 16-18S | 149-59E | 6 m 94302, Learmonth Airport (Australia) | 22-14S | 114-05E | 5 m 94312, Port Hedland Pardoo (Australia) | 20-06S | 119-34E | 9 m 94326, Alice Springs Aerodrome (Australia) | 23-48S | 133-53E | 545 m 94332, Mount Isa Amo (Australia) | 20-40S | 139-28E | 342 m 94374, Rockhampton Airport (Australia) | 23-23S | 150-28E | 10 m 94403, Geraldton Airport (Australia) | 28-47S | 114-42E | 37 m 94430, Meekatharra Airport (Australia) | 26-36S | 118-32E | 522 m 94461, Giles (Australia) | 25-02S | 128-17E | 580 m 94510, Charleville Airport (Australia) | 26-24S | 146-16E | 306 m 94578, Brisbane Airport M. O (Australia) | 27-23S | 153-06E | 4 m 94610, Belmont Perth Airport (Australia) | 31-56S | 115-57E | 20 m 94637, Kalgoorlie Boulder Amo (Australia) | 30-47S | 121-27E | 367 m 94638, Esperance (Australia) | 33-49S | 121-53E | 25 m 94647, Eucla Amo (Australia) | 31-41S | 128-54E | 93 m 94653, Ceduna Airport (Australia) | 32-07S | 133-42E | 23 m 94659, Woomera Aerodrome (Australia) | 31-08S | 136-49E | 165 m 94672, Adelaide Airport (Australia) | 34-56S | 138-31E | 6 m 94711, Cobar (Australia) | 31-29S | 145-49E | 264 m 94750, Nowra Ran Air Station (Australia) | 34-57S | 150-32E | 122 m 94767, Sydney Airport (Australia) | 33-57S | 151-11E | 6 m 94776, Williamtown Aerodrome (Australia) | 32-47S | 151-49E | 9 m 94802, Albany Airport (Australia) | 34-56S | 117-48E | 71 m 94821, Mount Gambier Aerodrome (Australia) | 37-44S | 140-47E | 65 m 94866, Melbourne Airport (Australia) | 37-40S | 144-50E | 132 m 94910, Wagga Airport (Australia) | 35-09S | 147-27E | 221 m 94953, Strahan (Australia) | 42-09S | 145-19E | 8 m 94975, Hobart Airport (Australia) | 42-50S | 147-29E | 4 m 94995, Lord Howe Island (Australia) | 31-32S | 159-04E | 5 m 94996, Norfolk Island Airport (Australia) | 29-02S | 167-56E | 113 m 94998, Macquarie Island (Australia) | 54-29S | 158-57E | 6 m 95527, Moree Mo (Australia) | 29-29S | 149-50E | 214 m

[RAW data A*-countries]

ogimet_station-list: ogimet_station-list_2019jun.txt

rs1729 commented 4 years ago

Combined uwyo/ogimet station list 2019/06 stations_2019jun3.txt

Map Europe, Jun 2019 eu_pic

Some (test) stations like Ury (Meteomodem), Toulouse, Nuernberg (DFM), Vantaa (Vaisala) not included.

rs1729 commented 4 years ago

radiosonde types and data processing https://www.ecmwf.int/en/elibrary/17551-assessment-different-radiosonde-types-2015-2016 https://www.youtube.com/watch?v=-65Zeu7IBzQ

darksidelemm commented 3 years ago

Is there an updated version of this list? I'd be interested in making an interactive map where you can click on the launch site and get the info on what sonde is being used (i've been asked a few times what various sites near people are launching).

rs1729 commented 3 years ago

ogimet stations 2020/06 all_ogimet2020jun.txt station: sonde_type(s) # lat lon alt

station names ogilist_2020jun.txt

world2020jun

Some stations do not report their 2020 soundings. E.g. 01415 (Stavanger) and 01010 (Andøya) in Norway, 2019/06: http://www.ogimet.com/display_sondc.php?lang=en&estado=Norw&tipo=ALL&ord=DIR&nil=SI&fmt=txt&ano=2019&mes=06&day=01&hora=08&anof=2019&mesf=06&dayf=30&horaf=08&send=send 2020/06: http://www.ogimet.com/display_sondc.php?lang=en&estado=Norw&tipo=ALL&ord=DIR&nil=SI&fmt=txt&ano=2020&mes=06&day=01&hora=08&anof=2020&mesf=06&dayf=30&horaf=08&send=send http://weather.uwyo.edu/cgi-bin/sounding?region=np&TYPE=TEXT%3ARAW&YEAR=2020&MONTH=06&FROM=0100&TO=3000&STNM=01010 "Sorry, unable to generate 01010 ENAN Andoya Observations at 00Z 01 Jun 2020 - 00Z 30 Jun 2020" http://weather.uwyo.edu/cgi-bin/sounding?region=naconf&TYPE=TEXT%3ARAW&YEAR=2020&MONTH=06&FROM=0100&TO=3000&STNM=01415 "Sorry, unable to generate 01415 ENZV Stavanger Observations at 00Z 01 Jun 2020 - 00Z 30 Jun 2020"

However: http://weather.uwyo.edu/cgi-bin/bufrraob.py?datetime=2020-06-10%200:00:00&id=01010&type=TEXT:LIST http://weather.uwyo.edu/cgi-bin/bufrraob.py?datetime=2020-06-10%200:00:00&id=01415&type=TEXT:LIST

Also no 89009 (Amundsen-Scott South Pole Station) on ogimet, but http://weather.uwyo.edu/cgi-bin/sounding?region=ant&TYPE=TEXT%3ARAW&YEAR=2020&MONTH=06&FROM=0100&TO=3000&STNM=89009 i.e. 89009: 23 # -90.00 0.00 2830

rs1729 commented 3 years ago

2020/10 all2020oct.txt station: sonde_type(s) # lat lon alt

world2020oct Saudia Arabia were the first to use RS41. It seems that Iran is the first to switch to M20. Turkey uses DFM-17. Transition of U.S. Radiosonde Operations 1680MHz -> 403MHz not completed: us2020oct

WMO common code table

07: iMet 11: LMS6-403 13: RS92 14: RS92 17: DFM-09 22: RS-11G 23: RS41 24: RS41 35: iMS-100 41: RS41 42: RS41 52: RS92-NGP 54: DFM-17 63: M20 77: M10 82: LMS6-1680 84: iMet-54

rs1729 commented 3 years ago

University of Wyoming - Upper Air Soundings http://weather.uwyo.edu/upperair/sounding.html http://weather.uwyo.edu/upperair/bufrraob.shtml

Ogimet http://www.ogimet.com/sondc.phtml.en

Deutscher Wetterdienst (DWD) ftp://ftp-cdc.dwd.de/climate_environment/CDC/observations_germany/radiosondes/ Tracks: https://www.dwd.de/DE/leistungen/rasomon/rasomon.html

MET Norway https://thredds.met.no/thredds/catalog/remotesensingradiosonde/catalog.html netCDF4 data includes radiosonde serial numbers:

andoya (01010)  lat: 69.31522 lon: 16.13091 alt: 3.0m
2020-09-30T23:04:00Z # SN="R2150029" # type=24
2020-10-01T11:03:00Z # SN="R2150027" # type=24
2020-10-01T23:03:00Z # SN="R2150028" # type=24
2020-10-02T11:03:00Z # SN="R2150026" # type=24
[...]
orland (01241)  lat: 63.70552 lon: 9.61200 alt: 30.0m
2020-09-30T23:12:00Z # SN="001 2 13799" # type=77
2020-10-01T11:07:00Z # SN="001 2 13788" # type=77
2020-10-01T23:09:00Z # SN="001 2 13783" # type=77
2020-10-02T11:10:00Z # SN="001 2 13804" # type=77
[...]
sola (01415)  lat: 58.87423 lon: 5.66505 alt: 37.0m
2020-09-30T23:04:00Z # SN="R2150466" # type=24
2020-10-01T11:04:00Z # SN="R2150455" # type=24
2020-10-01T23:03:00Z # SN="R2150463" # type=24
2020-10-02T11:04:00Z # SN="R2150450" # type=24
[...]
blindern (01492)  lat: 59.94269 lon: 10.71946 alt: 95.0m
2020-10-21T11:19:00Z # SN="P2621127" # type=24
2020-10-28T11:43:00Z # SN="P2221265" # type=24

ekofisk (01400)  lat: 56.54264 lon: 3.22379 alt: 70.0m
2020-09-30T23:02:00Z # SN="R3020062" # type=23
2020-10-01T11:05:00Z # SN="R3020053" # type=23
2020-10-01T23:13:00Z # SN="R3020061" # type=23
2020-10-02T12:10:00Z # SN="R3020071" # type=23
[...]
bjornoya (01028)  lat: 74.50380 lon: 19.00120 alt: 20.0m
2020-09-30T23:11:00Z # SN="S0740741" # type=23
2020-10-01T11:12:00Z # SN="S0740768" # type=23
2020-10-01T23:11:00Z # SN="S0740746" # type=23
2020-10-02T11:12:00Z # SN="S0830468" # type=23
[...]
nyalesund (01004)  lat: 78.92321 lon: 11.92314 alt: 17.4m
2020-10-01T10:48:00Z # SN="R0340420" # type=23
2020-10-02T10:46:00Z # SN="R0410065" # type=23
2020-10-03T10:45:00Z # SN="R0230168" # type=23
2020-10-04T10:45:00Z # SN="R0410037" # type=23
[...]
janmayen (01001)  lat: 70.93966 lon: -8.66918 alt: 10.0m
2020-09-30T23:11:00Z # SN="004 2 10140" # type=77
2020-10-01T11:24:00Z # SN="004 2 10144" # type=77
2020-10-01T23:11:00Z # SN="004 2 10062" # type=77
2020-10-02T11:11:00Z # SN="004 2 10128" # type=77
[...]
janmayen_vaisala (01001)
2020-10-01T11:13:00Z # SN="R1720232" # type=23
2020-10-02T11:17:00Z # SN="R1640891" # type=23
2020-10-03T11:11:00Z # SN="R1640102" # type=23
2020-10-04T11:14:00Z # SN="R1640914" # type=23
[...]

generate gpx tracks: https://github.com/rs1729/RS/blob/master/tools/metno_netcdf_gpx.py

Norway 2020/10 no2020oct

mhaberler commented 3 years ago

The following site is used as radiosonde data source in https://skewt.org :

https://madis.ncep.noaa.gov/madis_raob.shtml

it has many, but not all of the sonde ascents I am interested in - for instance, it is missing Austrian ascents done by austrocontrol.at or zamg.ac.at .

mhaberler commented 3 years ago

the other source I found is the BUFR files which are used by the UofWyoming site:

I think those are the files: https://rda.ucar.edu/datasets/ds351.0/index.html#sfol-wl-/data/ds351.0?g=121

you need an account (free and easy to get) at the rda.ucar.edu website to see and access those files

rs1729 commented 3 years ago

2021/01 all2021jan.txt station: sonde_type(s) # lat lon alt world2021jan 07: iMet 11: LMS6-403 13: RS92 14: RS92 17: DFM-09 22: RS-11G 23: RS41 24: RS41 35: iMS-100 41: RS41 42: RS41 52: RS92-NGP 54: DFM-17 63: M20 77: M10 82: LMS6-1680 84: iMet-54

bazjo commented 3 years ago

Inspired by this data, two friends of mine who are better in web development than I am and myself started working on a GIS type web application that shows radiosonde launch sites, hunters and receive stations. Anyone is able to propose an addition/deletion, this proposal is sent via email to an administrator/mailing list, who can approve it through a simple link that contains a token and allows modifications before accepting.

The web app uses laravel and vue and a prototype with no working mail functionality is deployed at https://gis.sondehunt.de/ The project repo sits at https://github.com/sondehunt/SondeGIS

Due to time constraints, we will not be able to finish this project in the near future. However, I still think this is a tool which definitely solves a problem and if anyone is interested in taking over development, I would be very happy

darksidelemm commented 3 years ago

Looking good! I'm wondering what that 'proprietary site' is. Though it looks like all the receive site data is just random at the moment?

For now the listener data for auto_rx stations can be grabbed from http://spacenear.us/tracker/receivers.php however you will have to filter for 'radiosonde_auto_rx' in the description field to exclude stations that may be listening for amateur radio balloons.

auto_rx is currently in the process of transitioning to a separate elasticsearch DB system with a new API, so eventually listener data will be available there. If you are interested, we now have all of the auto_rx collected data in ES using a somewhat more generic format detailed here. API information on submitting and accessing data is here. We have also been accepted into the AWS Open Data program, so this dataset will also be available in a S3 bucket fairly soon, though elasticsearch is more useful for searching through the data.

LukePrior commented 3 years ago

I've just made a quick custom Google Maps to show the data: https://www.google.com/maps/d/u/0/edit?mid=11LzaG62fG9ETXNbP7-TldoRsbsKCzBJ3&usp=sharing

If anyone wants the Python code or data sets used let me know and I will upload them.

rs1729 commented 3 years ago

@LukePrior Did you combine all2021jan.txt and the data from @bazjo's project?

I was thinking about doing the next map with Leaflet/python/folium. For 03/2021 I generated also a json file: all2021mar.txt all2021mar.json.zip Here the new map: https://rs1729.github.io/maps/station_map_2021mar.html

07: iMet-1 11: LMS6-403 13: RS92 14: RS92 17: DFM-09 19: MRZ-N1 22: RS-11G 23: RS41 24: RS41 34: iMet-4 35: iMS-100 41: RS41 42: RS41 52: RS92-NGP 54: DFM-17 62: MRZ-3MK 63: M20 77: M10 82: LMS6-1680 84: iMet-54

Code Tables to Binary and Alphanumeric Codes: C02.xml

world2021mar

mhaberler commented 3 years ago

neat idea I added frequency and sonde type to the station tooltips here: https://radiosonde.mah.priv.at/dev/

NB I'm coming "from the other side" - this information is extracted from BUFR files distributed by the meteo community, not from sonde observations

darksidelemm commented 3 years ago

Does that BUFR data include the transmit frequency information? Otherwise how are you getting the frequency data?

rs1729 commented 3 years ago

@mhaberler So your data is based on rda.ucar.edu https://github.com/rs1729/RS/issues/15#issuecomment-761536572 ? The BUFR data has much more information than the TAC reports. Maybe I should register on that website. The BUFR data http://weather.uwyo.edu/upperair/bufrraob.shtml is also good, but it has no raw data.

My data here https://github.com/rs1729/RS/issues/15#issuecomment-812677589 is based on the TAC TEMPs from http://www.ogimet.com/sondc.phtml.en with some adds from http://weather.uwyo.edu/upperair/sounding.html and MET Norway https://thredds.met.no/thredds/catalog/remotesensingradiosonde/catalog.html Their netCDF4 data is also very detailed.

mhaberler commented 3 years ago

yes it does

this is a GeoJSON file of radiosonde ascent in FM94 format, which is pretty much a direct transliteration of the BUFR file, see towards the end

note that there are two formats being used - FM35/netCDF by NOAA/MADIS and FM94/BUFR by the rest of the world

only the latter carry this much detail

this summary lists all the available ascents in the last 2 weeks, and carries the serial, frequency and sonde type info

mhaberler commented 3 years ago

@mhaberler So your data is based on rda.ucar.edu #15 (comment) ?

no, I am pulling data from GISC Offenbach and NOAA Madis, see here https://github.com/mhaberler/radiosonde-datacollector and here: https://github.com/mhaberler/radiosonde-datacollector/blob/master/installation.md

the BUFR processing is here: https://github.com/mhaberler/radiosonde-datacollector/blob/master/bufrutil.py

mhaberler commented 3 years ago

http://weather.uwyo.edu/upperair/bufrraob.shtml

I have asked the owner of this website repeatedly for the bufrraob.py script behind this page, but it seems to be a state secret

rs1729 commented 3 years ago

Thanks. Looks like most of the stations are now uploading much more detailed information about their soundings. If GISC Offenbach has all the data at one place, I will take a look. I knew that DWD and Met Norway had this kind of data, with flight path etc., good to know that this data is available also for other countries, and all at one place in one format.

The initial idea was to have a map of the radiosonde types used by the stations. But it's nice to have also their sounding data with one click. And it's nice that they report also the radiosonde serial number and frequency of each sounding.

mhaberler commented 3 years ago

there are about 12-15 or so meteo aggregators called "GISC" a small subset can actually be recommended, the rest of the crowd is pretty much a desolate state wrt access to open data: DE/Offenbach, JP/Tokyo, Brasil

GISC Moscow seems to have interesting data but I am still working on getting an account there - not easy

Meteo FR has their own game - does not distribute via the GISC system

There is one mystery I have not solved yet - the NOAA MADIS service has good coverage but only in FM35 format

for instance Russia: I get a few stations as FM94 via DWD, but all others as FM35 via NOAA - no idea why; I am very sure the rest of the Russian stations are available somewhere in FM94 but have not figured this out

mhaberler commented 3 years ago

here are example files for the Graz, Austria (wmo 11240) 2021-04-04 02:00Z ascent

link to the raw GeoJSON file: https://radiosonde.mah.priv.at/data/fm94/11/240/2021/04/11240_20210404_020000.geojson

the zip archive as it arrives from GISC Offenbach: https://static.mah.priv.at/public/temp-fm94_20210404-032500350082_28654.zip the BUFR file extracted from there: https://static.mah.priv.at/cors/bufr/A_IUSD04LOWM040200_C_EDZW_20210404032300_37086583.bin the BUFR file decoded to JSON with bufr_dump: https://static.mah.priv.at/cors/bufr/A_IUSD04LOWM040200_C_EDZW_20210404032300_37086583.json

a Python decoder skeleton created by bufr_dump -DPython A_IUSD04LOWM040200_C_EDZW_20210404032300_37086583.bin : https://static.mah.priv.at/cors/bufr/A_IUSD04LOWM040200_C_EDZW_20210404032300_37086583.py

rs1729 commented 3 years ago

Well, https://gisc.dwd.de/wisportal/#SearchPlace:Search [SUBSCRIPTIONS]/Default Carts/TEMP_Data-global_FM94/ shows 1165 entries for all the stations that are in this data base I guess. If I select a data set, I can download the bufr data for this station, though I believe it is only the latest sounding? It's a bin file. The second entry seems to be several stations in South America or Brasil. I found the station I was interested in, but I don't want to go through all the entries to make sense of the file names. Is there an overview or a zip file that has the data of all soundings for a particular synoptic time? Don't know if there is an archive with more history and where I could do automated download for the last month e.g.? Maybe there are more options if you are registered and signed in. @mhaberler You subscribed to a service that delivers each new sounding for every station? A simple archive where I could select stations and a time interval would be great? Do you know if this is possible? In general I don't like that you must register to get access to open data. The data archive of the DWD stations has ftp-access, that's ok.

mhaberler commented 3 years ago

yes, I recommend to sign up and register - it is the way to set up a subscription and related delivery service

you have several options of receiving the files, I have dwd push zip files via HTTP push so no periodic ftp needed

the subscription mechanism is a bit hokey but once set up it runs very reliable - the key disadvantage IMO is that once you find other sources (the TEMP_Data-global_FM94 is the right place to start) it is a tedious process to add sources to an existing feed

I wound up having several subscriptions and certainly there is overlap such that I get some sites twice and I do not have the nerve to click through gazillion pages and detect dupes manually

yes, you get only the latest soundings

I keep a window of two weeks of zip files, I can make that available via the web server if you are interested in those - maybe an easier start running through all of those if you are just extracting some attributes

mhaberler commented 3 years ago

sorry for the permission denied on the example files above, fixed

this is the 14-day window of BUFR archives I receive from GISC Offenbach: https://radiosonde.mah.priv.at/dwd-bufr/

nginx fragment for the push delivery:

    # incoming location for gisc.dwd.de https push delivery
    location /incoming {
        autoindex on;
        root /var/spool/gisc-offenbach/;
        client_body_temp_path /var/spool/gisc-offenbach/tmp;
        dav_methods PUT;
        create_full_put_path off;
        dav_access group:rw all:r;

        if (-d $request_filename) {
            rewrite ^(.*[^/])$ $1/ break;
        }

        auth_basic "Username and Password Required";
        auth_basic_user_file /etc/nginx/htpasswd/htpasswd.gisc;
    }
rs1729 commented 3 years ago

Thanks, that's a good starting point, before I subscribe to the bufr delivery.

mhaberler commented 3 years ago

as for the WMO source of active stations, I was advised by a meteo pro to use https://oscar.wmo.int/oscar/vola/ as the source (updated daily)

it is the base for https://github.com/mhaberler/radiosonde-datacollector/blob/dev/station_list.txt which I currently manually curate - every now and then a legit station pops up which is missing there, and I manually add those

mhaberler commented 3 years ago

not sure this is the right place to ask:

I am interested in matching sonde serials with launch stations - I'd appreciate pointers to existing work/code for that problem

LukePrior commented 3 years ago

Hi @rs1729 I have integrated your latest data set into the testing branch of the SondeHub Tracker. You can enable launch site icons from the settings menu under Other. I have attributed the dataset back to this issue but if you would like it elsewhere let me know. If you have any suggestions for improving the feature or other features on the tracker please let me know.

rs1729 commented 3 years ago

New map 2021/06: https://rs1729.github.io/maps/station_map_2021jun.html all2021jun.json.zip (some stations are missing)

07: iMet-1 11: LMS6-403 13: RS92 14: RS92 17: DFM-09 19: MRZ-N1 22: RS-11G 23: RS41 24: RS41 34: iMet-4 35: iMS-100 41: RS41 42: RS41 52: RS92-NGP 54: DFM-17 62: MRZ-3MK 63: M20 77: M10 82: LMS6-1680 84: iMet-54

@LukePrior, some stations didn't have launches in 2021/06 or didn't report their launches. (There is sounding data for Cape Canaveral, but no radiosonde type specified. Some time ago it was LMS6-403 (type=11).) On SondeHub you probably want a map that also shows stations that operate only occasionally (e.g. Elsenborn), i.e. data covering the last year or so? Do you plan to update the sondehub station map based on user observations?

F5MVO commented 2 years ago

Hi, can you add Payerne in Switzerland in the list used on Habhub please, its forgot

rs1729 commented 2 years ago

If I don't forget, I can add it next time (if I see soundings but no reports on ogimet). For Sondehub you have to ask @LukePrior .

It's probably 06610: 41,42 # 46.82 6.95 490 { "station": "06610", "rs_types": ["41", "42"], "lat": 46.82, "lon": 6.95, "alt": 490, "station_name": "Payerne" } (10/2020)

LukePrior commented 2 years ago

For Sondehub you have to ask @LukePrior .

Hey thanks for formatting it for me, I've dropped it into the testing branch at testing.v2.sondehub.org. @F5MVO please confirm you can see it and I will merge it into main.

https://github.com/projecthorus/sondehub-tracker/blob/testing/launchSites.json

Cheers

rs1729 commented 2 years ago

@LukePrior Sorry, I forgot the country name, i.e. { "station": "06610", "rs_types": ["41", "42"], "lat": 46.82, "lon": 6.95, "alt": 490, "station_name": "Payerne (Switzerland)" }

LukePrior commented 2 years ago

Updated thanks.

rs1729 commented 2 years ago

@LukePrior Seems to me that some coordinates in the ogimet database are a bit off. E.g. station 68263, Pretoria Irene (South Africa), station_pretoria

ogimet: 68263: -25.92 28.22 1523 # Pretoria Irene (South Africa) The igra2 station list is more accurate when I look at the map, igra2 : SFM00068263 -25.9100 28.2111 1526.0 PRETORIA (IRENE)

So Pretoria 68263 should be updated to { "station": "68263", "rs_types": ["84"], "lat": -25.91, "lon": 28.21, "alt": 1526, "station_name": "Pretoria Irene (South Africa)" }

There might be other stations with inaccurate coordinates.

EDIT: I guess these are rounding errors # TEMP/PILOT from 68263, Pretoria Irene (South Africa) | 25-55S | 028-13E | 1523 m is the original rounded low resolution ogimet data.

LukePrior commented 2 years ago

E.g. station 68263, Pretoria Irene (South Africa),

I have updated this individual entry and will look into creating a way for users to report inaccurate positions.

F5MVO commented 2 years ago

Hi, its ok for Payerne now, thanks

rs1729 commented 2 years ago

@LukePrior Next time I will use the more accurate igra2 station list and 4 decimal places in the json list. I see, you have already done this. Can you output 4 decimal places in your list even if the last digits are 0?

Here are a few additional corrections:

  {"station":"01001","rs_types":["77","23"],"lat":70.9397,"lon":-8.6678,"alt":10,"station_name":"Jan Mayen (Norway)"},
  {"station":"01004","rs_types":["23"],"lat":78.9233,"lon":11.9222,"alt":8,"station_name":"Ny-Alesund Ii (Norway)"},
  {"station":"01010","rs_types":["24"],"lat":69.3153,"lon":16.1308,"alt":3,"station_name":"Andoya (Norway)"},
  {"station":"01028","rs_types":["23"],"lat":74.5039,"lon":19.0011,"alt":20,"station_name":"Bjornoya (Norway)"},
  {"station":"01241","rs_types":["77"],"lat":63.7056,"lon":9.6117,"alt":30,"station_name":"Orland (Norway)"},
  {"station":"01400","rs_types":["23"],"lat":56.5422,"lon":3.2236,"alt":70,"station_name":"Ekofisk (Norway)"},
  {"station":"01415","rs_types":["24"],"lat":58.8742,"lon":5.6650,"alt":37,"station_name":"Stavanger / Sola (Norway)"},
  {"station":"02836","rs_types":["24","42"],"lat":67.3667,"lon":26.6289,"alt":179,"station_name":"Sodankyla (Finland)"},

  {"station":"06447","rs_types":["23"],"lat":50.7969,"lon":4.3581,"alt":100,"station_name":"Uccle (Belgium)"},
  {"station":"06610","rs_types":["41","42"],"lat":46.8117,"lon":6.9425,"alt":490,"station_name":"Payerne (Switzerland)"},

  {"station":"11120","rs_types":["42"],"lat":47.2603,"lon":11.3439,"alt":581,"station_name":"Innsbruck-Flughafen (Austria)"},
  {"station":"11240","rs_types":["42"],"lat":46.9931,"lon":15.4392,"alt":340,"station_name":"Graz-Thalerhof-Flughafen (Austria)"},

  {"station":"26708","rs_types":["62","90","19"],"lat":54.69639,"lon":20.76583,"alt":14,"station_name":"Kaliningrad (Russia)"},

The Norwegian stations are also in the netcdf-data that they publish (no ogimet data). It's very close to the igra2 coordinates:

(01001) janmayen   lat: 70.93965 lon: -8.66914 alt: 10.0m
(01004) nyalesund  lat: 78.92321 lon: 11.92314 alt: 17.4m
(01010) andoya     lat: 69.31522 lon: 16.13091 alt: 3.0m
(01028) bjornoya   lat: 74.50380 lon: 19.00120 alt: 20.0m
(01241) orland     lat: 63.70542 lon:  9.61193 alt: 30.0m
(01400) ekofisk    lat: 56.54264 lon:  3.22379 alt: 70.0m
(01415) sola       lat: 58.87423 lon:  5.66505 alt: 37.0m
(01492) blindern   lat: 59.94269 lon: 10.71946 alt: 95.0m
LukePrior commented 2 years ago

Next time I will use the more accurate igra2 station list and 4 decimal places in the json list. I see, you have already done this. Can you output 4 decimal places in your list even if the last digits are 0?

Yep that sounds great will do.

I will update those corrections shortly.

rs1729 commented 2 years ago

New map 2022/04: https://rs1729.github.io/maps/station_map_2022apr.html

07: iMet-1 11: LMS6-403 13: RS92 14: RS92 17: DFM-09 19: MRZ-N1 22: RS-11G 23: RS41 24: RS41 34: iMet-4 35: iMS-100 41: RS41 42: RS41 52: RS92-NGP 54: DFM-17 62: MRZ-3MK 63: M20 77: M10 82: LMS6-1680 84: iMet-54

map2022apr_z5

rs1729 commented 4 months ago

New map 2024/01: https://rs1729.github.io/maps/station_map_2024jan.html optional layer with igra2 coordinates; based on all2024jan.json.zip

some notable coordinate differences ogimet/igra2:

station (lat, lon, alt)
40437:  King Khaled International Airport (Saudi Arabia)   ogimet:(24.48 , 44.36 , 625)  -  igra:(24.9333 , 46.7167 , 614.0) KING KHALED INT. AIRPORT
43014:  Aurangabad Chikalthan Aerodrome (India)   ogimet:(19.85 , 73.40 , 585)  -  igra:(19.8500 , 75.4000 , 585.0) AURANGABAD CHIKALTHANA AERODR
97072:  Palu / Mutiara (Indonesia)   ogimet:(-0.92 , 119.91 , 84)  -  igra:(-0.6833 , 119.7333 , 6.0) PALU/MUTIARA
44292:  Ulaan-Baator (Mongolia)   ogimet:(47.92 , 106.85 , 1303)  -  igra:(47.9167 , 106.8667 , 1729.0) ULAANBAATAR
53845:  Yan An (China)  ogimet:(36.58 , 109.45 , 1180)  -  igra:(36.5667 , 109.4500 , 958.9) YAN AN
74005:  Yuma Proving Grounds, Az (K1y8) (United States)   ogimet:(32.86 , -114.03 , 10)  -  igra:(32.8636 , -114.0331 , 231.0) YUMA PRVGR

map_z5cut

rs1729 commented 4 months ago

The station coordinates in the ogimet database have limited precision. In most cases igra2 is closer to reality, but sometimes the igra2 coordinates are less accurate. E.g. Lindenberg 10393 ogimet: N52.21 E14.12 98m igra2: N52.2167 E14.1167 112.0m Sondehub: N52.2094 E14.1203

lindenberg_10393