search

IATI / refresher

A Python application which has the responsibility of tracking IATI data from around the Web and refreshing the core IATI software's data stores
GNU Affero General Public License v3.0
2 stars 0 forks source link

Migration to remove DDS tables/columns/constraints #19

Closed akmiller01 closed 3 years ago

akmiller01 commented 3 years ago

Successfully tested a refreshloop locally with new migration:

$ python3 src/handler.py -t refreshloop
2021-08-05 13:29:33,802 - refresh - INFO - DB upgrading to version 0.1.9
2021-08-05 13:29:33,802 - refresh - INFO - Making schema upgrade in migration 9
2021-08-05 13:29:33,813 - refresh - INFO - Start service loop
2021-08-05 13:29:33,813 - refresh - INFO - Begin refresh
2021-08-05 13:29:33,813 - refresh - INFO - Syncing publishers from the Registry...
akmiller01 commented 3 years ago

Currently getting an error... Seeing whether it's a function of my migration or perhaps local dev env configuration:

    stale_datasets = db.getFilesNotSeenAfter(conn, start_dt)
  File "/home/alex/git/refresher/src/library/db.py", line 511, in getFilesNotSeenAfter
    cur.execute(sql, data)
psycopg2.errors.InFailedSqlTransaction: current transaction is aborted, commands ignored until end of transaction block
akmiller01 commented 3 years ago

Made it through the refresh with that last commit!

python3 handler.py -t refresh
2021-08-06 09:02:04,619 - refresh - INFO - DB at correct version
2021-08-06 09:02:04,619 - refresh - INFO - Begin refresh
2021-08-06 09:02:04,619 - refresh - INFO - Syncing publishers from the Registry...
2021-08-06 09:14:39,179 - refresh - INFO - Publishers synced. Updating publishers in DB...
2021-08-06 09:14:39,179 - refresh - INFO - Syncing documents from the Registry...
2021-08-06 09:15:10,252 - refresh - INFO - ...Registry result got. Updating DB...
2021-08-06 09:15:19,129 - refresh - INFO - Documents synced.
2021-08-06 09:15:19,129 - refresh - INFO - End refresh.