breedfides / airflow-etl

0 stars 2 forks source link

Implement soil data fetching DAG (GPKG) #11

Closed brightemahpixida closed 6 months ago

brightemahpixida commented 8 months ago

Expected behaviour

There are ready-to-use DAGs for the soil spatial dataset. This DAG shall extract data from the link provided by @vineetasharma105 :

Soil

The datasets are stored in .gpkg format, and it encompasses the soil density for the whole of Germany. The netCDFs are zipped. The soil data shall be downloaded, the dataset will then be read in via GeoPandas and the data is clipped to the given lat / long position + 3km radius from the input.

P.S. @gannebamm / @vineetasharma105 please correct me if this description is incorrect :)