HHS / simpler-grants-gov

https://simpler.grants.gov
Other
29 stars 9 forks source link

[Task]: run load in chunks to prevent Oracle error ORA-01555 #1978

Closed jamesbursa closed 1 month ago

jamesbursa commented 1 month ago

Summary

Running the load in prod failed for some tables with an Oracle error. See #1956.

psycopg.errors.FdwUnableToCreateExecution: error fetching result: OCIStmtFetch2 failed to fetch next result row DETAIL: ORA-01555: snapshot too old: rollback segment number 21 with name "_SYSSMU21_2881811878$" too small

The solution is to limit the size of each insert and update by dividing it into chunks.

Acceptance criteria