Example pipeline for FIA - Githubissues

pangeo-forge / staged-recipes

A place to submit pangeo-forge recipes before they become fully fledged pangeo-forge feedstocks

https://pangeo-forge.readthedocs.io/en/latest/

Apache License 2.0

39 stars 63 forks source link

Example pipeline for FIA #3

Open jhamman opened 4 years ago

jhamman commented 4 years ago

## Source Dataset

The Forest Inventory and Analysis (FIA) dataset from the U.S. Forest Service is a collection of in situ observations of forest parameters.

https://apps.fs.usda.gov/fia/datamart/CSV/datamart_csv.html
CSV
One file per data stream - total about 30 CSVs.
Individual CSV or bulk Zip file
- Bulk zip file: https://apps.fs.usda.gov/fia/datamart/CSV/ENTIRE.zip
- Individual CSV: https://apps.fs.usda.gov/fia/datamart/CSV/PLOT.csv
No registration or authentication required

Transformation / Alignment / Merging

Just some clean up of the CSVs, data type parsing, etc. There isn't a natural way to concatenate this dataset.

Output Dataset

30 parquet datasets

rabernat commented 3 years ago

This requires https://github.com/pangeo-forge/pangeo-forge/issues/94.