search

palewire / first-web-scraper

A step-by-step guide to writing a web scraper with Python
https://palewi.re/docs/first-web-scraper/
GNU General Public License v3.0
203 stars 165 forks source link

showmeboone.com is frequently inaccessible. #2

Closed digen closed 11 months ago

digen commented 9 years ago

I would suggest a different website/URL for demonstrating web scraping. Possibly, will write one by this weekend where the website is hosted on one of my server allowing for web scraping without breaking any laws/Terms of use.

palewire commented 9 years ago

One thing I'd like to see in a replacement is pagination of the target data table, so that we could add another step at the end of the lesson that takes it beyond just scraping a simple table.

It is a natural next step in learning how to scrape and I think it would more clearly demonstrate the power of learning this skill, since many software tools that don't require programming can pull a table pretty easily, but might struggle with pagination.

digen commented 9 years ago

Valid point. Perhaps demonstrating both in the document should help the user in understanding the usefulness. I'll work on this accordingly.

andylolz commented 9 years ago

showmeboone.com is frequently inaccessible

Can I suggest self-hosting the example in this repo (and using rawgit.com or github pages to serve it).

palewire commented 11 months ago

This is now a different URL