vswilliamson / urlgrep

Automatically exported from code.google.com/p/urlgrep
0 stars 0 forks source link

URLgrep v0.5.7 ##############

Please visit http://code.google.com/p/urlgrep/

Below are the currently supported options:

-u link, --url link target webpage's url -d n, --depth n set the depth of the crawler (default=1) -a, --all specify this option if you want to search in pages that link outside -r exp, --regexp exp the regular expression you want to apply (see example below) -i, --ignore-case case insensitive search -m, --invert-match invert the sense of matching -o file, --output file will dump all matching URLs into the specified file -t n, --timeout n set the timeout when requesting a page (default=5 seconds) -c file, --cookie file specify your cookie file -n, --no-threads won't use threads -v ,--verbose verbose mode -h, --help show the help and usage