Limit the number of page scanned per site

mozilla / spade

Automated scraping markup+CSS from a list of relevant URLs, using a variety of user-agent strings. Provides reporting on usage of CSS properties and apparent user-agent sniffing.

22 stars 9 forks source link

Limit the number of page scanned per site #65

Open maurodoglio opened 11 years ago