Adds management commands to work with openlibrary dump files (https://openlibrary.org/developers/dumps). As of right now the resulting files are still prohibitively large to work with but I now have a 10GB fixture file of 4 million records and 8 million items, which is 4x the size of IndyPL. Muahahaha. It's also slow as hell because we need to fix indexing, but at least we have the ability to test with it now.
Relevant issue: N/a
Description:
Adds management commands to work with openlibrary dump files (https://openlibrary.org/developers/dumps). As of right now the resulting files are still prohibitively large to work with but I now have a 10GB fixture file of 4 million records and 8 million items, which is 4x the size of IndyPL. Muahahaha. It's also slow as hell because we need to fix indexing, but at least we have the ability to test with it now.
Checklist: