As a stakeholder/dashboard frontend designer I would like to see the ward data of more than one district (city)
As a developer I want to properly design/develop/test ward processing of more than one district.
[ ] Get access to a second source of ward data next to the existing Mumbai source
[ ] Implement the needed tasks to consume the data
[ ] Validate that if either one of the two districts tasks fails, the other still completes including further processing of that data
Allowing failing dependencies only seems possible with this:
https://pypi.org/project/luigi-soft-failures/
We might need to use this for the ward data acquisition step. The alternative, independently running ward data collection, imputation and computation is not feasible till we switch to a concurrent repository. google sheets wont behave nicely when multiple tasks try to update the same sheet.
Nozziel
commented
3 years ago
As a stakeholder/dashboard frontend designer I would like to see the ward data of more than one district (city) As a developer I want to properly design/develop/test ward processing of more than one district.
Allowing failing dependencies only seems possible with this: