metno / pyaro-readers

implementations of readers for the pyaerocom project using pyaro as interface
GNU Lesser General Public License v2.1
0 stars 2 forks source link

Make the aeronetsunreader really read Aeronet sun data #4

Closed jgriesfeller closed 11 months ago

jgriesfeller commented 11 months ago

Right now it's just a copy of the pyaro's csvreader

jgriesfeller commented 11 months ago

Issue to track implementation of Aeronet reading using pyaero:

  1. AeronetSun Level 3 version 2.0 daily averages delivered via single zip file using the URL https://aeronet.gsfc.nasa.gov/data_push/V3/All_Sites_Times_Daily_Averages_AOD20.zip The zip file contains a single file with all stations one time step in single line (~500MB)
  2. AeronetSun Level 3 version 1.5 all points delivered as tar.gz file using the URL https://aeronet.gsfc.nasa.gov/data_push/V3/AOD/AOD_Level15_All_Points_V3.tar.gz The tar file consists of one file per station (tar file is over 5GB already and represents a very large data set)

The reason to use these two formats is that the Aeronet Inversion product is distributed as tar.gz file only while the older products also available as zip file

Aeronet is also distrubuted via a web API, so we could add an implementation using that as well.