search

openaustralia / morph

Take the hassle out of web scraping
https://morph.io
GNU Affero General Public License v3.0
463 stars 74 forks source link

SSL problem with Ruby scraper on morph.io only #939

Open henare opened 8 years ago

henare commented 8 years ago

This scraper runs fine locally but there's an error on morph.io https://morph.io/openaustralia/alaveteli_versions

e-e-e commented 8 years ago

This also is evident here - https://github.com/planningalerts-scrapers/darebin

henare commented 8 years ago

OK, that's really interesting. I'd assumed this was a problem with the mitmproxy but that's currently disabled due to #986.

e-e-e commented 8 years ago

I think someone at the hack-fest was experiencing a similar issue locally and solved it by updating the cert files that ruby referenced. They were supposedly out-dated. Not a solution but perhaps a pointer to a possibility.

LoveMyData commented 7 years ago

Another one just started - https://morph.io/planningalerts-scrapers/sutherland