LibrariesHacked / openlibrary-search

Searching Open Library by keywords to return ISBNs
147 stars 26 forks source link

Postgres tables only loading 2000 rows a table #12

Closed DVARGIT closed 1 year ago

DVARGIT commented 1 year ago

Using the batch process script openlibrary-data-chunk-process.py and following it with the openlibrary-db.sql only loads 2000 rows per created table and seems to stop after that. Postgres version is 15.2, everything else is fine and the processed files are in the data/processed folder.