search

jolaf / vimeo-crawler

Automatic downloader of videos from Vimeo.com
http://vimeo.com
2 stars 4 forks source link

ERROR Message: Reached error page: about:neterror? #1

Open chuchienshu opened 6 years ago

chuchienshu commented 6 years ago 
python VimeoCrawler.py  https://vimeo.com/categories/sports
2018-06-07 20:51:10    INFO 
2018-06-07 20:51:10    INFO VimeoCrawler v2.14 (c) 2013-2016 Vasily Zakharov vmzakhar@gmail.com
2018-06-07 20:51:10    INFO Starting Firefox...
2018-06-07 20:52:44   ERROR Message: Reached error page: about:neterror?e=netTimeout&u=https%3A//vimeo.com/categories/sports&c=UTF-8&f=regular&d=The%20server%20at%20vimeo.com%20is%20taking%20too%20long%20to%20respond.

2018-06-07 20:52:45    INFO Crawling completed with 1 errors
2018-06-07 20:52:45   ERROR Here's the summary of warnings and errors encountered:
https://vimeo.com/categories/sports
  ERROR Message: Reached error page: about:neterror?e=netTimeout&u=https%3A//vimeo.com/categories/sports&c=UTF-8&f=regular&d=The%20server%20at%20vimeo.com%20is%20taking%20too%20long%20to%20respond.
2018-06-07 20:52:45    INFO Checking for obsolete files...
2018-06-07 20:52:45    INFO Done

hi, @jolaf . While I googled some relevant solutions, I still cannot make it work.looking forward to your reply. thx!

jolaf commented 6 years ago

Hi!

I mostly stopped supporting this software, but I'd help however I can.

First of all, make sure to use the latest Selenium: https://pypi.org/project/selenium If you're using Linux, the package available in your distribution may be older, so remove it and install the latest one using pip.

Firefox manufacturers keep changing staff all the time, and Selenium has hard time keeping up. If the latest Firefox doesn't work with the latest Selenium, downgrade Firefox until it can. For now, you may try v56.

jolaf commented 6 years ago

As for login problems, Vimeo guys also keep changing things in their page structure, so the script needs to be tweaked as they do it.

Unfortunately, I don't have time any longer to keep track of these changes and update the script, though you're free to fork it.

It's really not that complex, you may find that "#page_header h1 a" selector in the code and update it to something relevant to the current Vimeo page structure.

Good luck to you with that!