hampelm / ideas

0 stars 0 forks source link

Put NYC permit data online in a better format #39

Open hampelm opened 8 years ago

hampelm commented 8 years ago

NYC Building Permits A building can have multiple jobs. A job can have multiple permits.

Jobs are the most interesting of the two, because they detail the work to be done an estimated cost. Other interesting things they record:

Permits are interesting because they have the name of the business (”Permittee’s Business Name”), a personal name for the business (often the name of the owner), and other related information. Both the permit and job data have the property owner’s name and business name.

The data

The online system is pretty good, especially if you want to skim the data or do a quick search. You can start with a BIN, job, or permit number, and drill up or down to the details: http://a810-bisweb.nyc.gov/bisweb/PropertyProfileOverviewServlet?requestid=2&bin=1077836. (Sure, it doesn’t look great – but the pages load in ¾ of a second)

The open data is here: https://data.cityofnewyork.us/Housing-Development/DOB-Permit-Issuance/ipu4-2q9a

That’s usually around 400,000 rows of open permits (are they all open?) on a particular day. The CSV export is around 300MB.

_The historical reports are here: _ http://www.nyc.gov/html/dob/html/codes_and_reference_materials/statistics.shtml

This is where you can easily get bulk data

The job reports list jobs issued in a given month. I don’t know if the same job ID can appear across multiple months. A given month might have 9,000+ jobs.

That page also has complaint reports. There is a searchable database of bad construction professionals at http://www.nyc.gov/html/dob/html/safety/iad.shtml. You can probably connect the two to permit

Are there duplicate permits across months? Duplicate jobs across months?

How people use the data

Historical permits http://www.metrohistory.com/searchfront.htm

Sweeten permit dot map: https://sweeten.com/maps

NY Times search: http://realestate.nytimes.com/community/building_permits.aspx

Weekly monitor of violations

http://www.buildingviolation.com/newyork.html

hampelm commented 8 years ago

This sheet has the daily data: https://data.cityofnewyork.us/Housing-Development/DOB-Permit-Issuance/ipu4-2q9a

DOB Run Date seems to be a good way to only get the newest results.