SocialFinanceDigitalLabs / sf-fons-platform

https://github.com/SocialFinanceDigitalLabs/sf-fons
1 stars 0 forks source link

Pipeline: Port Episodes fix to dagster #69

Open patrick-troy opened 6 months ago

patrick-troy commented 6 months ago

Stephen Carter has been working on fixing issues with Episodes files in SSDA903, these are issues that arise towards the end of reporting periods and result in duplicate rows or missing information.

This needs to sit after the pan_agg process but before the sufficiency process.

It is currently working with the CLI pipeline but needs to be converted to work with the Dagster pipeline