commercetest / vitals-scraper

Collect data to assist in analysing Google Play Console Android Vitals
MIT License
6 stars 2 forks source link

Scraper fails to run for more than the first app #25

Closed julianharty closed 5 years ago

julianharty commented 5 years ago

14 is intended to enable the scraper to download the crashes for multiple apps. However, it currently only downloads the crashes for the first of the apps listed. The connection times-out with an error for the second app, and the program then finishes rather than continuing further.

ℹ Getting and writing crash clusters to [/<removed>/vitals-scraper/android-crash-clusters_1569596277768.json] [31/32] [97%]
✔ [org.kiwix.kiwixcustomwikimed] Getting and writing crash clusters to [/<removed>/vitals-scraper/android-crash-clusters_1569596277768.json]

Successfully scraped [org.kiwix.kiwixcustomwikimed]
Scraping package [org.kiwix.kiwixcustomphet]
- [org.kiwix.kiwixcustomphet] Getting and writing crash clusters to [/<removed>/vitals-scraper/android-crash-clusters_1569596742370.json]
✖ [org.kiwix.kiwixcustomphet] Getting and writing crash clusters to [/<removed>/vitals-scraper/android-crash-clusters_1569596742370.json]
Failed to scrape [org.kiwix.kiwixcustomphet]
✖ [4:05:55 PM] Failed to scrape after [523729ms]: Error: Protocol error (Page.navigate): Session closed. Most likely the page has been closed.

I have an idea where the problem is in the code and am testing a possible fix.

julianharty commented 5 years ago

Fixed and tested, time to close this issue.