search

antarctica / asli-pipeline

This repository contains a pipeline for operational execution of the Amundsen Sea Ice Low calculations, provided in the asli package. The functions in the asli package are described in detail in the package repository amundsen-sea-low-index.
MIT License
0 stars 0 forks source link

Adapt config to specify output method #12

Closed thomaszwagerman closed 1 week ago

thomaszwagerman commented 2 weeks ago

Adapt the config and .sh to allow the user to choose between output methods, S3 or local file system.

Currently only set up to work with S3 method to support JASMIN object store

thomaszwagerman commented 1 week ago

Also change output format:

filesystem = csv object store = parquet

thomaszwagerman commented 1 week ago

file format specification requires changes in asli_calc (in the asli package), shelf for now