pantherdb / fullgo_paint_update

Update of Panther and PAINT DBs with monthly GO release data
0 stars 0 forks source link

Improve logging during DB update query execution #54

Open dustine32 opened 3 years ago

dustine32 commented 3 years ago

The SQL update queries have been sped up to the point where they can reliably be executed through a python DB adapter (psycopg2) without timeouts or connections lost. I believe this now allows us to tie together and automate the full process, with improved, clearer logging to detect issues.

To help better organize the code, maybe use something like SQLAlchemy that can map tables to objects?