gbv / coli-ana

API to analyze DDC numbers
https://coli-conc.gbv.de/coli-ana/app/
MIT License
2 stars 0 forks source link

Adjust import/convert script to use less memory #27

Closed stefandesu closed 3 years ago

stefandesu commented 3 years ago

I got an error while importing a large dataset today where Node ran out of memory. We should find out how to fix that. There shouldn't be a need to load all the data into memory before importing it into the database.