opensrp / opensrp-scripts

Customised OpenMRS ETL for Report Requirements in OpenSRP Projects
Apache License 2.0
1 stars 2 forks source link

New ETL Output CSV #12

Closed moshthepitt closed 6 years ago

moshthepitt commented 7 years ago

Create a new CSV output which has data aggregated by date for all the aggregations that we typically need.

This would make consumption of the output data much more easier and pleasant.

@claycrosby @jasonrogena @keymane @githengi

csc5k commented 7 years ago

Would we store this in a table where each row is a date and each column is the to-date aggregation?

Right now the to-date aggregate numbers we need are:

I'll confirm whether there aren't any more that we'll need

moshthepitt commented 7 years ago

@claycrosby I think we could store all the aggregations we need for a date, including any running totals

csc5k commented 7 years ago

OK cool, so just to be clear, we're now looking at 3 ETLs total for ZEIR:

1) registrations (ticket #10) 2) encounters (ticket #11) 3) to-date aggregations (this ticket)

Each of these ETLs would correspond to its own table in Superset

I'll update this ticket with any other aggregations we need beyond the 3 listed in my post above

csc5k commented 6 years ago

Closing because was able to accomplish this using some nested SQL statements for ZEIR Dropout metrics (tickets #17 and #18 )