search

devinit / ddw-analyst-ui

The Development Data Warehouse
http://ddw.devinit.org/
GNU General Public License v3.0
2 stars 1 forks source link

Separate iati_transactions into raw_iati_activities, raw_iati_transactions, and iati_transactions #773

Open akmiller01 opened 2 years ago

akmiller01 commented 2 years ago

Where iati_transactions.py and iati_transaction_spec.py presently only create one iati_transactions table which contains multiple user-friendly transformations of the data, it would be useful to separately collect raw IATI activities into a table, raw IATI transactions into a table, and then follow the current iati_transaction_spec as a means of combining those two tables into the output that is presently in iati_transactions.

k8hughes commented 2 years ago

Not removing the original table, just creating two more...

akmiller01 commented 2 years ago

Correct @k8hughes , I meant the refresh/reload process would separate the current inflow of data into three tables instead of just the one.

stale[bot] commented 2 years ago

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.