search

website-scraper / website-scraper-puppeteer

Plugin for website-scraper which returns html for dynamic websites using puppeteer
MIT License
324 stars 80 forks source link

Problems of Redirection #24

Closed LZY2006 closed 1 year ago

LZY2006 commented 3 years ago

There is a "page turn button" that implemented with javascript, and it redirects to another page on the website. The problem is that the script saves it to the "redirection page", not the final page.(My English is poor, i don't know how to describe it.) For example: a.com/changepage.jsp.html --> a.com/art/some.html and the script will save the content of "a.com/art/some.html" to "local/a.com/changepage.jsp.html". I want it to save the content of "a.com/art/some.html" to "local/a.com/art/some.html" I have set blockNavigation to false. Is it a bug?

s0ph1e commented 3 years ago

Hi @LZY2006 👋 Thank you for reporting the issue. It looks like a bug, I'll take closer look on it

stale[bot] commented 2 years ago

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.