Custom URL extraction for found URLs that are being grabbed

ArchiveTeam / NewsGrabber

Grabbing all news.

62 stars 32 forks source link

Custom URL extraction for found URLs that are being grabbed #46

Open Arkiver2 opened 8 years ago

Arkiver2 commented 8 years ago

Many pages have images and other page requisites which aren't extracted by wpull automatically. Add a scripts to exrtact these URLs from the pages too.