psf / requests-html

Pythonic HTML Parsing for Humans™
http://html.python-requests.org
MIT License
13.64k stars 977 forks source link

Browser closed unexpectedly #552

Open akul-goyal opened 1 year ago

akul-goyal commented 1 year ago

Hi, I am trying to run the following code:

from requests_html import HTMLSession
session = HTMLSession()
r = session.get('https://python.org/')
r.html.render()

and I get the following error.

Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
  File "/home//YouTubeScrapper/venv/lib/python3.8/site-packages/requests_html.py", line 586, in render
    self.browser = self.session.browser  # Automatically create a event loop and browser
  File "/home//YouTubeScrapper/venv/lib/python3.8/site-packages/requests_html.py", line 730, in browser
    self._browser = self.loop.run_until_complete(super().browser)
  File "/home//anaconda3/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/home//YouTubeScrapper/venv/lib/python3.8/site-packages/requests_html.py", line 714, in browser
    self._browser = await pyppeteer.launch(ignoreHTTPSErrors=not(self.verify), headless=True, args=self.__browser_args)
  File "/home//YouTubeScrapper/venv/lib/python3.8/site-packages/pyppeteer/launcher.py", line 307, in launch
    return await Launcher(options, **kwargs).launch()
  File "/home//YouTubeScrapper/venv/lib/python3.8/site-packages/pyppeteer/launcher.py", line 168, in launch
    self.browserWSEndpoint = get_ws_endpoint(self.url)
  File "/home//YouTubeScrapper/venv/lib/python3.8/site-packages/pyppeteer/launcher.py", line 227, in get_ws_endpoint
    raise BrowserError('Browser closed unexpectedly:\n')
pyppeteer.errors.BrowserError: Browser closed unexpectedly:

I have tried running this on multiple servers and am getting the same error.

keisanng commented 12 months ago

Same error here.

ajatkj commented 11 months ago

This project uses pyppeteer which is uses very old version of Chromium. This is easily fixable. You can check my comment on another issue here.