search

vswilliamson / urlgrep

Automatically exported from code.google.com/p/urlgrep
0 stars 0 forks source link

a url can't get crawled! #2

Open GoogleCodeExporter opened 9 years ago

GoogleCodeExporter commented 9 years ago 
why ?
./urlgrep.pl -u 
"www.netfilter.org/documentation/HOWTO/packet-filtering-HOWTO.html" -r 
"\.html$" -d 1 

### $host: 'www.netfilter.org'
# Running URLgrep on 
www.netfilter.org/documentation/HOWTO/packet-filtering-HOWTO.html
# Regexp: /\.html$/
# Started on Sat Dec 15 07:35:44 2012 
.
### @crawled: []

### @crawled: [
###             
'www.netfilter.org/documentation/HOWTO/packet-filtering-HOWTO.html'
###           ]

### $content: undef

# Finished on Sat Dec 15 07:35:44 2012 
[OK] Crawl done [1 URL(s) visited].
[KO] No target found.

Original issue reported on code.google.com by yef....@gmail.com on 15 Dec 2012 at 7:43

GoogleCodeExporter commented 9 years ago 
use Smart::Comments;

the @crawled content displayed in first &parseURL($entry_url, 0)

Original comment by yef....@gmail.com on 15 Dec 2012 at 7:46