[short_descr]
Watch the web network as a palm tree. Very Useful For Target Website Overview.
[/short_descr]
[long_descr]
Take a look
What is webpalm?
webpalm is a command-line tool that traverses a website and generates a tree of all the webpages and their links, additionally it can dump data from the body of the pages using regular expressions then store the result in a file.
Features
[x] Generate a palm tree struct of web urls
[x] Dump data from body pages using regular expressions
[x] live output mode
[x] Export the webtree to json, xml, txt
[x] Fast and easy to use
[x] Colorized output and error handling
When to use webpalm?
web palm is specially used in OSINT level.
when you want to get a quick overview of a website structure
or when you want to check if there is any sensitive data using regex
it is good at spidering in websites networks and go in depth
Installation
From source
git clone https://github.com/XORbit01/webpalm.git
cd webpalm
go build -o webpalm && ./webpalm
wget https://github.com/XORbit01/webpalm/releases/download/v0.0.1/webpalm_x.x.x_os_arch.tar.gz
tar -xvf webpalm_x.x.x_os_arch.tar.gz
cd webpalm
./webpalm
if you have go installed
go install github.com/XORbit01/webpalm@v0.0.2
Usage
webpalm -h
Flags:
-x, --exclude-code ints status codes to exclude / ex : -x 404,500
-h, --help help for webpalm
-i, --include strings include only domains / ex : -i google.com,facebook.com
-l, --level int level of palming / ex: -l 2
--live live output mode (slow but live streaming) / ex: --live
-o, --output string file to export the result (f.json, f.xml, f.txt) / ex: -o result.json
--regexes stringToString regexes to match in each page / ex: --regexes comments="\<\!--.*?--> (default [])
-u, --url string target url / ex: -u https://google.com
Examples
get the palm tree of a website:
webpalm -u https://google.com -l1 --live
get palm tree of a website and exclude some status codes:
webpalm -u https://google.com -l1 -x 404,500
get the palm tree of a website and dump data from the body of the pages:
[homepage] https://github.com/XORbit01/webpalm [/homepage]
[tags] tree, webpalm, website, OSINT, enumeration [/tags]
[short_descr] Watch the web network as a palm tree. Very Useful For Target Website Overview. [/short_descr]
[long_descr]
Take a look
What is webpalm?
webpalm is a command-line tool that traverses a website and generates a tree of all the webpages and their links, additionally it can dump data from the body of the pages using regular expressions then store the result in a file.
Features
When to use webpalm?
web palm is specially used in OSINT level. when you want to get a quick overview of a website structure or when you want to check if there is any sensitive data using regex it is good at spidering in websites networks and go in depth
Installation
From source
From binary
you can download the binary from Releases
if you have go installed
Usage
Examples
get the palm tree of a website:
get palm tree of a website and exclude some status codes:
get the palm tree of a website and dump data from the body of the pages:
this will dump the comments of each page in the body of the page
this will dump the comments and emails of each page in the body of the page
get the palm tree of a website and export it to xml,txt:
get the palm tree of a website and include only some domains:
this will crawl only the urls that contains google.com or facebook.com
Regexes Examples
Don't forget escaping the regexes if needed [/long_descr]
[image]
[/image]