While the page_post scraper works fine, I get incomplete results for the page_comments.
Based on the comment count provided with each post, I should get around 14000 comments for my query. However, when running the script to retrieve these comments, it only downloads around 5800 comments. This seems strange because I don't get any error messages and Python tells me that the scraping has been completed successfully.
Does anyone know what the problem is and how to solve it?
Hi,
thanks a lot for uploading the code!
While the page_post scraper works fine, I get incomplete results for the page_comments.
Based on the comment count provided with each post, I should get around 14000 comments for my query. However, when running the script to retrieve these comments, it only downloads around 5800 comments. This seems strange because I don't get any error messages and Python tells me that the scraping has been completed successfully.
Does anyone know what the problem is and how to solve it?
I would really appreciate the help! :)