kraemer-lab / DART-Pipeline

Data analysis pipeline for the Dengue Advanced Readiness Tools (DART) project
https://dart-pipeline.readthedocs.io
MIT License
2 stars 0 forks source link

Refactor modular #111

Closed abhidg closed 2 months ago

abhidg commented 2 months ago

Putting up for review -- process tests need to be written and the output QC checked. Plots will also need to be ported to the new refactored architecture. Tracking progress in #106.

Many data sources do not allow their data to be redistributed (APHRODITE, GADM), will have to figure out how to cache and run tests on them without distributing them with the GitHub repo. Once schemas are finalised, will also have to add schema validation tests.

abhidg commented 2 months ago

@rowannicholls thanks for the review! will make the changes to the README -- uv is meant to be installed outside the venv and will manage the .venv folder by itself.

For metrics requiring two data sources, the process will fail with shapefile not found - will think of a structured way of specifying dependencies.