Open wsshopping opened 9 years ago
https://github.com/binux/pyspider/issues/new#fullscreen
when i use the patomjs parse the webpage http://www.zhanqi.tv/games/lol, load next page is invalid, more detalis as follows: you can use this enviroment : http://demo.pyspider.org/debug/dengxiaobing
i want to scrap the total list of lol, but the result is just 30 ,and i run the scripts in web console, it works fine . that is : setInterval("window.scrollTo(0,document.body.scrollHeight)",5000);
Try to change the height of page view in pyspider/fetcher/pantomjs_fetcher.js
height
page.viewportSize = { width: 1024, height: 768000 }
to a smaller size, 768 for instance.
https://github.com/binux/pyspider/issues/new#fullscreen
when i use the patomjs parse the webpage http://www.zhanqi.tv/games/lol, load next page is invalid, more detalis as follows: you can use this enviroment : http://demo.pyspider.org/debug/dengxiaobing
i want to scrap the total list of lol, but the result is just 30 ,and i run the scripts in web console, it works fine . that is : setInterval("window.scrollTo(0,document.body.scrollHeight)",5000);