search

maverick193 / magento-full-page-cache-crawler

Magento Full Page Cache Crawler
17 stars 10 forks source link

Exclude from crawling #4

Open paul-hph opened 8 years ago

paul-hph commented 8 years ago

is i possible to exclude pages from Crawling?

for example:

image

image

maverick193 commented 7 years ago

Hi Paul, Sorry for this late answer, had no time to look into my github modules. This is good idea, since those dynamic urls should not be crawled, I'll put a "blacklist" where administrators can put their Urls which does not have to be crawled.

paul-hph commented 7 years ago

👍