search

covidatlas / coronadatascraper

COVID-19 Coronavirus data scraped from government and curated data sources.
https://coronadatascraper.com
BSD 2-Clause "Simplified" License
364 stars 179 forks source link

Scraping agents, resources and free tool to help in this project #424

Closed vickyRathee closed 4 years ago

vickyRathee commented 4 years ago

Hey there!

Vikash from Agenty here. We'd love to offer a FREE Agenty account to help in setting up scraper quickly using our point-and-click extension with instant preview and more.

https://chrome.google.com/webstore/detail/agenty-advanced-web-scrap/gpolcofcjjiooogejfbaamdgmgfehgff

We already have some agents (in our public dataset) and experts web scraping team to build more. https://www.agenty.com/docs/how-to/how-to-scrape-covid-19-data-from-websites

image

No promotion, just want to help!

jzohrab commented 4 years ago

Hello @vickyrathee , thank you for contacting the team! We've been swamped, and haven't been sure how to use this offer.

Our scrapers are built with javascript, scraping from public sources. As sources change, we have to deal with the thrash ... it's tough! How does your team/tool deal with this problem? If a source updates, how do your scrapers deal with it?

I'm not sure how our tools could collaborate, or how/if we could use your data. Ours is open source, I don't think yours is, and I'm not sure of your data sources. We're using gov't sources only.

What are your thoughts? Cheers, Jeff

jzohrab commented 4 years ago

Closing due to no response. We need to understand data sources, transparency, etc. Thank you though @vickyrathee, cheers! jz