kemusa / nowala-mobile

Nowala Mobile App
0 stars 0 forks source link

Automate data pipeline for in-app dashboard #9

Open kmatsuno opened 2 years ago

kmatsuno commented 2 years ago

What problem are we solving

Currently we do not have an automated way to update the data on our sponsor's dashboard. This requires us to manually input the data into the database which is not a scalable solution and provides high risk of data inaccuracy.

Hypothesis

We believe automating the data pipeline for dashboard Will result in delivering accurate updated data to our users in timely manner We will have confidence to proceed when we see the data updated without any manual process

Propose solution

Data flow diagram

In-App updated

  1. Automate household allocation to sponsors

    • [ ] Create nowala_mst.assets table
    • [ ] Automate data extracts from Angaza
    • [ ] SQL to join assets table with angaza data
  2. Monthly payment update

    • [ ] Create summary_tables.assets
  3. Impact metrics calculation

    • [ ] Create summary_tables.assets
  4. Checklist update

    • [ ] Money arrived in SL: not sure how we can collect this data
    • [ ] Partner has money: Update through Wise API?
    • [ ] Home selected and installation done: Update based on summary_tables.assets

Considered alternatives

  1. Connecting the data from Airtable
  2. Automate data extract from Angaza

Additional context

kmatsuno commented 2 years ago

@kemusa You can refer to this airtable to get the Monthly payment and Impact metric update https://airtable.com/appbUvvVdVHBT2L6i/tblsQnlxGTmjZXlqL/viwPHYuWF5PYLGOJX?blocks=hide