Changes made while scraping the whole Project Gutenberg data.

r-three / common-pile

Repo to hold code and track issues for the collection of permissively licensed data

MIT License

22 stars 6 forks source link

Closed blester125 closed 8 months ago

blester125 commented 8 months ago

This PR includes some updates I made while processing all the Project Gutenberg data.

Changes include:

Use the shared logger
Strip whitespace from start/end of books
Uses the default value for --books which skips/adds specific special case books