search

simsong / bulk_extractor

This is the development tree. Production downloads are at:
https://github.com/simsong/bulk_extractor/releases
Other
1.04k stars 183 forks source link

integrate with a web scraper #399

Open simsong opened 1 year ago

zdavatz commented 1 year ago

Currently, when doing

wget -r website.com

and then

bulk_extractor -o website -R website.com

the process

bulk_extractor -o website -R website.com

takes forever.

zdavatz commented 1 year ago

If the webscraper is better then wget -r then it could make sense having a scraper with a separate option.