search

City-Bureau / city-scrapers-philly

City Scrapers for Philadelphia
MIT License
0 stars 1 forks source link

Scrape A Google Calendar? #9

Open haileyhoyat opened 1 year ago

haileyhoyat commented 1 year ago

@jamesturk Hi James, it's me Hailey. We worked together last year on the City Bureau City Scrapers project (I was building out the scrapers for Fresno).

Wanted to get your guidance on something. The below link is a Google Calendar on a web page. I remember you cautioning against scraping Google products. Would you say it's safe to scrape this calendar or should I not do that? Thanks.

https://www.dallascounty.org/about-us/calendar/

jamesturk commented 1 year ago

Hi Hailey (of course I remember!)

Generally speaking yes, they're pretty quick to block/throttle in my experience, and being blocked/throttled from Google is generally pretty frustrating. (Everyone on the same IP having to do captchas for search)

Sometimes you can get an ICS link which is safe to use from Google Calendar but I'm not seeing a way on this embed from a quick look.

haileyhoyat commented 1 year ago

@jamesturk Gotcha, in that case I won't scrape this one. Thanks and hope you're enjoying teaching.