evolvingweb / sitediff

SiteDiff makes it easy to see differences between two versions of a website.
http://sitediff.io
GNU General Public License v2.0
229 stars 48 forks source link

URLs with the www subdomain are not crawled #167

Open mahieddineak opened 1 year ago

mahieddineak commented 1 year ago

If a website's URL is www.example.com, and we have the URL example.com in the sitediff.yaml file, SiteDiff will ignore all URLs with www. Therefore, no pages will be crawled. SiteDiff checks URLs for an exact match with the URL in the configuration file, but it might be worth considering an exception for the www. subdomain.