search

open-austin / construction-permits

:construction: City of Austin Construction Permits
The Unlicense
10 stars 1 forks source link

No new data #26

Open mateoclarke opened 7 years ago

mateoclarke commented 7 years ago

It looks like we're running the job daily, but the last date I find data is from April, 18, 2016.

https://github.com/open-austin/construction-permits/blob/master/data/2016/2016-04-18.csv

Perhaps the site changed around that date? Or they are blocking our call?

davemcphee commented 7 years ago

Looks like they're sending back an .xls file now - but trying to get it with requests lib is giving me an empty html table for some reason. Weird.

mscarey commented 7 years ago

I looked at this issue in the "Which of our featured projects are still working/up?" audit. Is it important to get the permit scraper working again and fill in the gap in the data? Or is the data.austintexas.gov dataset sufficient now? Is it time to turn off the scraper and stop updating this repo? What do you think @luqmaan @mateoclarke @davemcphee @spatialaustin @wilsaj?

johnclary commented 7 years ago

I think it's ok to retire the permit scraper. Construction permit data is available on the open data portal and apparently updated on a weekly basis: https://data.austintexas.gov/Building-and-Development/Issued-Construction-Permits/3syk-w9eu