Pipeline module 1: extract

[robperch]

The objective of this module will only be to ingest the data from the original source and saving it for the next steps of the process.

[robperch]

Hey @jefwei!

I've added some scripts to the repository on issue 26. Please pull these and try to make the first module work. Don't worry if you get stuck somewhere; it might not be easy at first.

The first module is called 'Extract' and its objective is to query the database and save the results locally as a pickle. We might make adjustments in the future, but for now, let's start with this.

Here are some key ideas:

• The main module is the 'extract_funcs.py' file. Your task is to complete the functions under the 'Unitary functions' header. These functions will then be executed by the function below the 'Compounded functions' header.
• You may need to add some parameters to the '[config.py](http://config.py/)' file.

Take a look and give it a try. Let me know if you encounter any issues and we can work on it together. Or also feel free to send me any questions.

[jefwei]

Currently running into this bug in extract_functions.py. I have attached the pictures for reference. In the second picture, variables utc_tz and mexico_tz are not defined in general_utils.py.