Re-write migration with cursor-side fetching

datamade / api.opencivicdata.org

:cloud: deployment stuff for api.opencivicdata.org

3 stars 3 forks source link

Closed reginafcompton closed 6 years ago

reginafcompton commented 6 years ago

This PR reduces the memory consumption by iterating over the mangled bills in small batches.