Closed edwardchalstrey1 closed 5 years ago
The extra / in the index url was stopping the crawler getting to higher numbered pages. I have checked and we now continue crawling past the previous 524 articles.
/
The extra
/in the index url was stopping the crawler getting to higher numbered pages. I have checked and we now continue crawling past the previous 524 articles.