ukaea / fair-mast-ingestion

Ingestion tool for the FAIR MAST project
1 stars 0 forks source link

Add pipelines to support MAST-U #16

Open samueljackson92 opened 3 weeks ago

samueljackson92 commented 3 weeks ago

This PR adds support for a basic MAST-U pipelines and job scripts for running on Friea and CSD3.

Create the metadata

mpirun -n 4 python3 -m src.create_uda_metadata ~/rds/rds-ukaea-mast-sPGbyCAPsJI/data/uda campaign_shots/mastu.csv

Run the ingestion to local file

mpirun -np 4 python3 -m src.main data/local campaign_shots/mast_u.csv --metadata_dir data/uda --source_names anb act acu ayc ayd epm esm --file_format nc --facility MASTU