search

owid / etl

A compute graph for loading and transforming OWID's data
https://docs.owid.io/projects/etl
MIT License
83 stars 22 forks source link

:sparkles: engineering: refactor Step paths #3165

Open Marigold opened 3 months ago

Marigold commented 3 months ago

Refactor Step paths like channel / namespace / version / name. Move the logic from bespoke functions to steps themselves and use Step properties to access them.

Add CatalogPath to centralize its parsing.

TODO

owidbot commented 3 months ago
Quick links (staging server): Site Dev Site Preview Admin Wizard Docs

Login: ssh owid@staging-site-step-path

chart-diff: ✅ No charts for review.
data-diff: ✅ No differences found ```diff Legend: +New ~Modified -Removed =Identical Details Hint: Run this locally with etl diff REMOTE data/ --include yourdataset --verbose --snippet ``` Automatically updated datasets matching _weekly_wildfires|excess_mortality|covid|fluid|flunet|country_profile|garden/ihme_gbd/2019/gbd_risk_ are not included

Edited: 2024-11-19 12:23:00 UTC Execution time: 3.92 seconds