catch' ./cewl.rb:766:in
Closed palyweb closed 2 years ago
Looks like I'm not catching the timeout exception from http://a-wareness.fr:80/ which shouldn't be timing out.
I'll give it a test later.
On Sun, 28 Feb 2021 at 18:28, palyweb notifications@github.com wrote:
Hello Robin Wood :) Unfortunately I can't CeWL my site: :( Do you have any ideas?
cewl http://a-wareness.fr --debug -v CeWL 5.4.8 (Inclusion) Robin Wood (robin@digi.ninja) (https://digi.ninja/) Starting at http://a-wareness.fr Pushing {nil=>"http://a-wareness.fr"} Checking page http://a-wareness.fr Comparing http://a-wareness.fr with http://a-wareness.fr
Unable to connect to the site (http://a-wareness.fr:80/)
The following error may help: execution expired /usr/lib/ruby/2.7.0/net/http.rb:960:in initialize' /usr/lib/ruby/2.7.0/net/http.rb:960:in open' /usr/lib/ruby/2.7.0/net/http.rb:960:in block in connect' /usr/lib/ruby/2.7.0/timeout.rb:105:in timeout' /usr/lib/ruby/2.7.0/net/http.rb:958:in connect' /usr/lib/ruby/2.7.0/net/http.rb:943:in do_start' /usr/lib/ruby/2.7.0/net/http.rb:932:in start' /usr/lib/ruby/2.7.0/net/http.rb:1483:in request' /usr/bin/cewl:246:in get_page' /usr/bin/cewl:176:in block (2 levels) in start!' /usr/bin/cewl:174:in each' /usr/bin/cewl:174:in block in start!' /usr/bin/cewl:162:in each' /usr/bin/cewl:162:in start!' /usr/bin/cewl:114:in start_at' /usr/bin/cewl:769:in block in ' /usr/bin/cewl:759:in catch' /usr/bin/cewl:759:in '
Caller /usr/bin/cewl:198:in get_page' /usr/bin/cewl:176:in block (2 levels) in start!' /usr/bin/cewl:174:in each' /usr/bin/cewl:174:in block in start!' /usr/bin/cewl:162:in each' /usr/bin/cewl:162:in start!' /usr/bin/cewl:114:in start_at' /usr/bin/cewl:769:in block in ' /usr/bin/cewl:759:in catch' /usr/bin/cewl:759:in '
End of main loop Words found End of wordlist loop End of email loop End of meta loop
— You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub https://github.com/digininja/CeWL/issues/72, or unsubscribe https://github.com/notifications/unsubscribe-auth/AAA4SWPYPT5G2T3WW57QTPLTBKDLVANCNFSM4YLKAHTA .
You aren't going to like this, it works fine for me.
The fact you are calling it from the path rather than from the current directory I'm guessing you are running a version that has been installed by a package manager. Give it a try with the latest from GitHub and see if that works.
Thank you for your feedback :) Yet CeWL works on other sites But problem still same from the last GitHub version :
./cewl.rb http://a-wareness.fr --debug -v CeWL 5.5.0 (Grouping) Robin Wood (robin@digi.ninja) (https://digi.ninja/) Starting at http://a-wareness.fr Pushing {nil=>"http://a-wareness.fr"} Checking page http://a-wareness.fr Comparing http://a-wareness.fr with http://a-wareness.fr
Unable to connect to the site (http://a-wareness.fr:80/)
The following error may help:
execution expired
/usr/lib/ruby/2.7.0/net/http.rb:960:in initialize' /usr/lib/ruby/2.7.0/net/http.rb:960:in
open'
/usr/lib/ruby/2.7.0/net/http.rb:960:in block in connect' /usr/lib/ruby/2.7.0/timeout.rb:105:in
timeout'
/usr/lib/ruby/2.7.0/net/http.rb:958:in connect' /usr/lib/ruby/2.7.0/net/http.rb:943:in
do_start'
/usr/lib/ruby/2.7.0/net/http.rb:932:in start' /usr/lib/ruby/2.7.0/net/http.rb:1483:in
request'
./cewl.rb:247:in get_page' ./cewl.rb:177:in
block (2 levels) in start!'
./cewl.rb:175:in each' ./cewl.rb:175:in
block in start!'
./cewl.rb:163:in each' ./cewl.rb:163:in
start!'
./cewl.rb:115:in start_at' ./cewl.rb:776:in
block in catch' ./cewl.rb:766:in
Caller
./cewl.rb:199:in get_page' ./cewl.rb:177:in
block (2 levels) in start!'
./cewl.rb:175:in each' ./cewl.rb:175:in
block in start!'
./cewl.rb:163:in each' ./cewl.rb:163:in
start!'
./cewl.rb:115:in start_at' ./cewl.rb:776:in
block in catch' ./cewl.rb:766:in
End of main loop Words found End of wordlist loop End of email loop End of meta loop
Weird.
Can you get to the site with curl? With the port number on it.
On Sun, 28 Feb 2021, 19:40 palyweb, notifications@github.com wrote:
Thank you for your feedback :) Yet CeWL works on other sites But problem still same from the last GitHub version :
./cewl.rb http://a-wareness.fr --debug -v CeWL 5.5.0 (Grouping) Robin Wood (robin@digi.ninja) (https://digi.ninja/) Starting at http://a-wareness.fr Pushing {nil=>"http://a-wareness.fr"} Checking page http://a-wareness.fr Comparing http://a-wareness.fr with http://a-wareness.fr
Unable to connect to the site (http://a-wareness.fr:80/)
The following error may help: execution expired /usr/lib/ruby/2.7.0/net/http.rb:960:in initialize' /usr/lib/ruby/2.7.0/net/http.rb:960:in open' /usr/lib/ruby/2.7.0/net/http.rb:960:in block in connect' /usr/lib/ruby/2.7.0/timeout.rb:105:in timeout' /usr/lib/ruby/2.7.0/net/http.rb:958:in connect' /usr/lib/ruby/2.7.0/net/http.rb:943:in do_start' /usr/lib/ruby/2.7.0/net/http.rb:932:in start' /usr/lib/ruby/2.7.0/net/http.rb:1483:in request' ./cewl.rb:247:in get_page' ./cewl.rb:177:in block (2 levels) in start!' ./cewl.rb:175:in each' ./cewl.rb:175:in block in start!' ./cewl.rb:163:in each' ./cewl.rb:163:in start!' ./cewl.rb:115:in start_at' ./cewl.rb:776:in block in ' ./cewl.rb:766:in catch' ./cewl.rb:766:in '
Caller ./cewl.rb:199:in get_page' ./cewl.rb:177:in block (2 levels) in start!' ./cewl.rb:175:in each' ./cewl.rb:175:in block in start!' ./cewl.rb:163:in each' ./cewl.rb:163:in start!' ./cewl.rb:115:in start_at' ./cewl.rb:776:in block in ' ./cewl.rb:766:in catch' ./cewl.rb:766:in '
End of main loop Words found End of wordlist loop End of email loop End of meta loop
— You are receiving this because you commented. Reply to this email directly, view it on GitHub https://github.com/digininja/CeWL/issues/72#issuecomment-787509663, or unsubscribe https://github.com/notifications/unsubscribe-auth/AAA4SWPD6IJHVF3YXNQIEI3TBKLZDANCNFSM4YLKAHTA .
Yes curl works ... :/
Is it slow to respond? If you can connect but CeWL gets a timeout it could be because it is slow to respond and CeWL times out before curl does.
On Sun, 28 Feb 2021, 22:05 palyweb, notifications@github.com wrote:
Yes curl works ... :/
— You are receiving this because you commented. Reply to this email directly, view it on GitHub https://github.com/digininja/CeWL/issues/72#issuecomment-787531599, or unsubscribe https://github.com/notifications/unsubscribe-auth/AAA4SWK3KOF5HWVURVCPDRTTBK42DANCNFSM4YLKAHTA .
Nop, very fast !!! Grrr, I don't understand. I'll try with another connection ;)
Do you have a proxy set up?
On Sun, 28 Feb 2021, 22:22 palyweb, notifications@github.com wrote:
Nop, very fast !!! Grrr, I don't understand. I'll try with another connection ;)
— You are receiving this because you commented. Reply to this email directly, view it on GitHub https://github.com/digininja/CeWL/issues/72#issuecomment-787534407, or unsubscribe https://github.com/notifications/unsubscribe-auth/AAA4SWKTCQCFIBFCMMKOBI3TBK6YVANCNFSM4YLKAHTA .
No
How's your ruby? I'll have a look at it tomorrow and send you some extra debug to add. We will get to the bottom of it.
If you could try it on another machine before that though, it would help rule out if it is that machine/install or if it is more widespread.
On Sun, 28 Feb 2021, 22:32 palyweb, notifications@github.com wrote:
No
— You are receiving this because you commented. Reply to this email directly, view it on GitHub https://github.com/digininja/CeWL/issues/72#issuecomment-787536527, or unsubscribe https://github.com/notifications/unsubscribe-auth/AAA4SWOF7ZEVLN3FY4YPNC3TBK777ANCNFSM4YLKAHTA .
ok after many tests, the problem comes from my IP address. It works on other sites but not on this one.
Thank you for your time ^^
Anything odd in your hosts file?
It could be a dependency issue with the pre-installed gems.
I don't like issues like this as they always mean something is wrong somewhere and I don't like not knowing! If you do manage to get any more clues to what it is, let me know.
On Mon, 1 Mar 2021 at 12:28, palyweb notifications@github.com wrote:
ok after many tests, the problem comes from my IP address. It works on other sites but not on this one.
Thank you for your time ^^
— You are receiving this because you commented. Reply to this email directly, view it on GitHub https://github.com/digininja/CeWL/issues/72#issuecomment-787911971, or unsubscribe https://github.com/notifications/unsubscribe-auth/AAA4SWLQA4WQNQPMA7WH5RDTBOCAVANCNFSM4YLKAHTA .
Hello Robin Wood :) Unfortunately I can't CeWL my site: :( Do you have any ideas?
cewl http://a-wareness.fr --debug -v CeWL 5.4.8 (Inclusion) Robin Wood (robin@digi.ninja) (https://digi.ninja/) Starting at http://a-wareness.fr Pushing {nil=>"http://a-wareness.fr"} Checking page http://a-wareness.fr Comparing http://a-wareness.fr with http://a-wareness.fr
Unable to connect to the site (http://a-wareness.fr:80/)
The following error may help: execution expired /usr/lib/ruby/2.7.0/net/http.rb:960:in'
/usr/bin/cewl:759:in '
initialize' /usr/lib/ruby/2.7.0/net/http.rb:960:in
open' /usr/lib/ruby/2.7.0/net/http.rb:960:inblock in connect' /usr/lib/ruby/2.7.0/timeout.rb:105:in
timeout' /usr/lib/ruby/2.7.0/net/http.rb:958:inconnect' /usr/lib/ruby/2.7.0/net/http.rb:943:in
do_start' /usr/lib/ruby/2.7.0/net/http.rb:932:instart' /usr/lib/ruby/2.7.0/net/http.rb:1483:in
request' /usr/bin/cewl:246:inget_page' /usr/bin/cewl:176:in
block (2 levels) in start!' /usr/bin/cewl:174:ineach' /usr/bin/cewl:174:in
block in start!' /usr/bin/cewl:162:ineach' /usr/bin/cewl:162:in
start!' /usr/bin/cewl:114:instart_at' /usr/bin/cewl:769:in
block incatch' /usr/bin/cewl:759:in
Caller /usr/bin/cewl:198:in'
/usr/bin/cewl:759:in '
get_page' /usr/bin/cewl:176:in
block (2 levels) in start!' /usr/bin/cewl:174:ineach' /usr/bin/cewl:174:in
block in start!' /usr/bin/cewl:162:ineach' /usr/bin/cewl:162:in
start!' /usr/bin/cewl:114:instart_at' /usr/bin/cewl:769:in
block incatch' /usr/bin/cewl:759:in
End of main loop Words found End of wordlist loop End of email loop End of meta loop