Open sunil3590 opened 4 years ago
Were you able to fix this? @sunil3590 Experiencing the same issue, Splash Down and all domains are down.
@Terrtia
I'm having a similar issue with Tor links where I get a "SPLASH DOWN" error but only with onion links.
Regular crawler however works.
Hello I have the same issue. Is there any update? thanks
Maybe I found the error in the screen logs (screen -r Crawlers_AIL):
File "/opt/AIL/bin/torcrawler/TorSplashCrawler.py", line 181, in parse
error_retry = request.meta.get('error_retry', 0)
NameError: name 'request' is not defined
@TheFausap @Terrtia did you find the fix for this? i also cant crawl any onion domain since they appear to be down
ISSUE I tried to crawl a regular domain (not .onion) and the status fo the domain comes up as DOWN. I've tried this will multiple domains and even .onion domains but the result is the same, all domains are DOWN.
SETUP I have AIL, TOR, and Splash all installed and running on a single machine with one docker instance of Splash running on 8050 and Tor running on 9050
Logs from Splash Docker
The line of code in Splash generating the error message above https://github.com/scrapinghub/splash/blob/9fda128b8485dd5f67eb103cd30df8f325a90bb0/splash/engines/webkit/browser_tab.py#L446