Bl-nK / torSpider

Spider for searching Onions for other Onions
10 stars 0 forks source link

https://reddit.com/r/onions Failed - Can't Spider #2

Closed tomtom87 closed 9 years ago

tomtom87 commented 9 years ago

Tried to run the example and get the following error

https://reddit.com/r/onions Failed - Can't Spider

Any ideas?

Bl-nK commented 9 years ago

Can you pull the latest code and try again? I made that error more verbose. It might give us an idea as to what happened.

Bl-nK commented 9 years ago

Adding on, I tried and got the following output with the new code.

https://reddit.com/r/onions Failed - Can't Spider - java.io.IOException: Server returned HTTP response code: 429 for URL: https://www.reddit.com/r/onions

429 stands for too many requests. This is on the Reddit side of things. Let me know if you have a different error please.

tomtom87 commented 9 years ago

Tried the new code, new error now:

 groovy onionFinder.groovy https://reddit.com/r/onions
https://reddit.com/r/onions Failed - Can't Spider - java.net.SocketException: Can't connect to SOCKS proxy:Connection refused
tomtom87 commented 9 years ago

Oh it assumes I run a proxy on localhost now?

System.properties.putAll( ["proxySet":"true","socksProxyHost":"localhost", "socksProxyPort":"9050"] )
Bl-nK commented 9 years ago

Yes, it requires that you are running Tor on your local system. Tor provides a SOCKS proxy that you can use to send data through Tor.