probberechts / soccerdata

⛏⚽ Scrape soccer data from Club Elo, ESPN, FBref, FiveThirtyEight, Football-Data.co.uk, FotMob, Sofascore, SoFIFA, Understat and WhoScored.
https://soccerdata.readthedocs.io/en/latest/
Other
579 stars 101 forks source link

[WhoScored] Chrome freeze after package update #674

Closed adlihs closed 2 weeks ago

adlihs commented 4 weeks ago

Hello,

After update the package to the new version, when I run my scripts to get data from WhoScored, chrome explorer freeze and after 12-15 minutes the next message error appears:

[08/14/24 11:05:35] ERROR    Error while scraping https://www.whoscored.com/Regions/252/Tournaments/2. Retrying in 0 seconds... (attempt 1 of 5).                                                                                                                                                                                                                                                                  _common.py:655
                             Traceback (most recent call last):                                                                                                                                                                                                                                                                                                                                                                  
                               File "/opt/anaconda3/envs/soccer-data/lib/python3.9/site-packages/soccerdata/_common.py", line 631, in _download_and_save                                                                                                                                                                                                                                                                         
                                 self._driver.get(url)                                                                                                                                                                                                                                                                                                                                                                           
                               File "/opt/anaconda3/envs/soccer-data/lib/python3.9/site-packages/undetected_chromedriver/__init__.py", line 665, in get                                                                                                                                                                                                                                                                          
                                 return super().get(url)                                                                                                                                                                                                                                                                                                                                                                         
                               File "/opt/anaconda3/envs/soccer-data/lib/python3.9/site-packages/selenium/webdriver/remote/webdriver.py", line 356, in get                                                                                                                                                                                                                                                                       
                                 self.execute(Command.GET, {"url": url})                                                                                                                                                                                                                                                                                                                                                         
                               File "/opt/anaconda3/envs/soccer-data/lib/python3.9/site-packages/selenium/webdriver/remote/webdriver.py", line 347, in execute                                                                                                                                                                                                                                                                   
                                 self.error_handler.check_response(response)                                                                                                                                                                                                                                                                                                                                                     
                               File "/opt/anaconda3/envs/soccer-data/lib/python3.9/site-packages/selenium/webdriver/remote/errorhandler.py", line 229, in check_response                                                                                                                                                                                                                                                         
                                 raise exception_class(message, screen, stacktrace)                                                                                                                                                                                                                                                                                                                                              
                             selenium.common.exceptions.TimeoutException: Message: timeout: Timed out receiving message from renderer: 296.883                                                                                                                                                                                                                                                                                   
                               (Session info: chrome=127.0.6533.120)                                                                                                                                                                                                                                                                                                                                                             
                             Stacktrace:                                                                                                                                                                                                                                                                                                                                                                                         
                             0   undetected_chromedriver             0x0000000104af18b8 undetected_chromedriver + 5179576                                                                                                                                                                                                                                                                                                        
                             1   undetected_chromedriver             0x0000000104ae92ea undetected_chromedriver + 5145322                                                                                                                                                                                                                                                                                                        
                             2   undetected_chromedriver             0x00000001046602b0 undetected_chromedriver + 389808                                                                                                                                                                                                                                                                                                         
                             3   undetected_chromedriver             0x0000000104648afa undetected_chromedriver + 293626                                                                                                                                                                                                                                                                                                         
                             4   undetected_chromedriver             0x000000010464881a undetected_chromedriver + 292890                                                                                                                                                                                                                                                                                                         
                             5   undetected_chromedriver             0x0000000104646d1b undetected_chromedriver + 285979                                                                                                                                                                                                                                                                                                         
                             6   undetected_chromedriver             0x00000001046471df undetected_chromedriver + 287199                                                                                                                                                                                                                                                                                                         
                             7   undetected_chromedriver             0x000000010465622b undetected_chromedriver + 348715                                                                                                                                                                                                                                                                                                         
                             8   undetected_chromedriver             0x000000010466c50d undetected_chromedriver + 439565                                                                                                                                                                                                                                                                                                         
                             9   undetected_chromedriver             0x00000001046718eb undetected_chromedriver + 461035                                                                                                                                                                                                                                                                                                         
                             10  undetected_chromedriver             0x0000000104647867 undetected_chromedriver + 288871                                                                                                                                                                                                                                                                                                         
                             11  undetected_chromedriver             0x000000010466c36f undetected_chromedriver + 439151                                                                                                                                                                                                                                                                                                         
                             12  undetected_chromedriver             0x00000001046ebdfe undetected_chromedriver + 962046                                                                                                                                                                                                                                                                                                         
                             13  undetected_chromedriver             0x00000001046ce553 undetected_chromedriver + 841043                                                                                                                                                                                                                                                                                                         
                             14  undetected_chromedriver             0x000000010469f7f6 undetected_chromedriver + 649206                                                                                                                                                                                                                                                                                                         
                             15  undetected_chromedriver             0x00000001046a005e undetected_chromedriver + 651358                                                                                                                                                                                                                                                                                                         
                             16  undetected_chromedriver             0x0000000104ab4b20 undetected_chromedriver + 4930336                                                                                                                                                                                                                                                                                                        
                             17  undetected_chromedriver             0x0000000104ab9a36 undetected_chromedriver + 4950582                                                                                                                                                                                                                                                                                                        
                             18  undetected_chromedriver             0x0000000104aba105 undetected_chromedriver + 4952325                                                                                                                                                                                                                                                                                                        
                             19  undetected_chromedriver             0x0000000104a96ee9 undetected_chromedriver + 4808425                                                                                                                                                                                                                                                                                                        
                             20  undetected_chromedriver             0x0000000104aba3f9 undetected_chromedriver + 4953081                                                                                                                                                                                                                                                                                                        
                             21  undetected_chromedriver             0x0000000104a88844 undetected_chromedriver + 4749380                                                                                                                                                                                                                                                                                                        
                             22  undetected_chromedriver             0x0000000104ad95c8 undetected_chromedriver + 5080520                                                                                                                                                                                                                                                                                                        
                             23  undetected_chromedriver             0x0000000104ad9787 undetected_chromedriver + 5080967                                                                                                                                                                                                                                                                                                        
                             24  undetected_chromedriver             0x0000000104ae8ece undetected_chromedriver + 5144270                                                                                                                                                                                                                                                                                                        
                             25  libsystem_pthread.dylib             0x00007ff807ae018b _pthread_start + 99                                                                                                                                                                                                                                                                                                                      
                             26  libsystem_pthread.dylib             0x00007ff807adbae3 thread_start + 15      

Any help?! Thanks in advance...

ds-oliver commented 3 weeks ago

This happening to me as well.

ds-oliver commented 3 weeks ago

Any updates on this?

probberechts commented 2 weeks ago

I cannot reproduce this. Make sure Chrome is up-to-date and that you have installed the latest version of undetected-chromedriver. If you still experience isssues after checking these things, it is better to look for help in the issue tracker of undetected-chromedriver.

ds-oliver commented 2 weeks ago

Have tried all things from fresh chrome download, downgrading selenium/undetected-chromedriver, etc.

You're having no issue running ws.read_schedule() and ws.read_events() for current 2425 season?

adlihs commented 2 weeks ago

@probberechts Mate, first of all thank you for time and help. Mate I used the same script for the last 6 months, I just change the value for current season and update the version of the package. And as @ds-oliver mentioned before I thing the issue is in ws.read_schedule() and ws.read_events() functions.