Open BnA-Robin opened 8 years ago
Use the sitemap by default to find more urls. Should implement sitemap format and recurse on sitemaps referring to other more details sitemaps. Disable the inspection of the sitemap using an option in the service itself.
Use the sitemap by default to find more urls. Should implement sitemap format and recurse on sitemaps referring to other more details sitemaps. Disable the inspection of the sitemap using an option in the service itself.