Refactor/Check the paths (create a simple flow)

[aloralove]

Check and make all paths consistent and CLEAR (variables, where the appends happen) and see where we can simplify, DRY and ensure each script is modular(ish)

1. Diagram which scripts have access to which variables

   • [x] download_event
   • [x] download_missing_file
   • [x] download
   • [x] generate_event_metadata
   • [x] get_events
   • [x] test_meter_connection
   • [ ] archive_data
   • [x] check_missing
   • [ ] commons
   • [x] create_metadata_yml
   • [x] data_pipeline

2. Suggest Changes

   • [x] download_event
   • [x] download_missing_file
   • [x] download
   • [x] generate_event_metadata
   • [x] get_events
   • [x] test_meter_connection
   • [ ] archive_data
   • [x] check_missing
   • [ ] commons
   • [x] create_metadata_yml
   • [x] data_pipeline

3. Make changes

   • [ ] download_event
   • [ ] download_missing_file
   • [ ] download
   • [ ] generate_event_metadata
   • [ ] get_events
   • [ ] test_meter_connection
   • [ ] archive_data
   • [ ] check_missing
   • [ ] commons
   • [ ] create_metadata_yml
   • [ ] data_pipeline

[nicolemah99]

without notes

with notes

obsidian://open?vault=Obs-AETB&file=Documentation%2FCAMIO%2FSTREAM%2Fscript_variables%202024-03-22%2010.48.54.excalidraw

[nicolemah99]

Changes to be made