If a view in Drupal has multiple pages it seems that only the first page is crawled and the rest are ignored. Is this by design? Is there a setting to enable crawling these pages? A large portion of my site is missing because the crawler ignores all the links that are like
/some/url/view?page=1
I tried adding .*\?page\=\d* to the include but that did not affect anything.
If a view in Drupal has multiple pages it seems that only the first page is crawled and the rest are ignored. Is this by design? Is there a setting to enable crawling these pages? A large portion of my site is missing because the crawler ignores all the links that are like /some/url/view?page=1
I tried adding
.*\?page\=\d*
to the include but that did not affect anything.