Scraping comments for each post together

TannerGilbert / Tutorials

Code for some of my articles

https://gilberttanner.com/

MIT License

561 stars 631 forks source link

Scraping comments for each post together #54

Closed Vibhuarvind closed 2 years ago

Vibhuarvind commented 2 years ago

what if I want to scrape posts along with the comment on each post into csv? How do i do it?

TannerGilbert commented 2 years ago

This depends on if the website is static or dynamic. If it's static, you can scrape it with BeautifulSoup and save the results into a CSV. If the website is dynamic, you'll need a tool that allows you to render the browser like Selenium. For more information, check out 'Python Web Scraping - Dynamic Websites'.

github-actions[bot] commented 2 years ago

This issue is stale because it has been open 30 days with no activity. Remove stale label or comment or this will be closed in 5 days