search

skadogg / personal-tv-guide

Python-based JustWatch scraper
GNU General Public License v3.0
6 stars 7 forks source link

🐛 Data gets out of sync if any show page scraping fails #72

Closed skadogg closed 7 months ago

skadogg commented 7 months ago

I scanned >900 shows earlier, and noticed that two of them failed or timed out. The job finished, but when it was done, the output was incorrect.

image

I'm pretty sure this happens because of how multiple, separate lists are joined together at the end. If everything runs as planned - no problem - but if anything fails, the data gets skewed.