leoncvlt / blinkist-scraper

📚 Python tool to download book summaries and audio from Blinkist.com, and generate some pretty output
191 stars 35 forks source link

Stability and transparency improvements #39

Closed rocketinventor closed 3 years ago

rocketinventor commented 3 years ago

The main features of this pull request are to reduce the frequency of errors (wait for the page to load & detect redirect to upgrade page), improve (clarity) of logging output, and allowing headless sign-in (which is now possible due to updated sign-in flow).


If an account does not have access to a book, the output will look like this:

[19:01:55] WARNING Book is not available on the selected account. Exiting...
[19:01:55] INFO Go Premium and get the best of Blinkist: https://www.blinkist.com/nc/plans

...and the webdriver will exit.


The output of the categories list now looks like this (without the [...] part):

[18:59:57] INFO Getting all Blinkist books from sitemap...
[19:01:13] INFO Found 3058 books
[19:01:39] INFO Scraping categories: Entrepreneurship, Politics, Marketing & Sales, Science, Health & Nutrition, [...]
leoncvlt commented 3 years ago

Sounds great, thanks @rocketinventor!