Explore ideas for how to design the ETL to pull data from different sources on a schedule. Some ideas that have already been floated are to use a python script potentially similar (but more advanced) to what was used in the hackathon . Another idea is to use foreign data wrappers.
[x] brainstorming session in Miro to explore ETL design options
[ ] initial plan for first set of data that needs to be integrated (CIIP, SWRS)
Brainstorming / Discussion ticket.
Explore ideas for how to design the ETL to pull data from different sources on a schedule. Some ideas that have already been floated are to use a python script potentially similar (but more advanced) to what was used in the hackathon . Another idea is to use foreign data wrappers.