Empty zip files from batch downloader (esp. 2012)

edrubin commented 7 years ago

A large set of the files I downloaded from the batch downloader yield empty folders upon downloading and unzipping.

Alabama is missing 2012
Colorado is missing 1996 and 2012
Connecticut is missing 1998
Illinois is missing 2012
Mississippi is missing 2012
Nebraska is missing 2012
New Hampshire is missing 2012 and 2013
Oregon is missing 2012 and 2013
Pennsylvania is missing 2012 and 2013
Virginia is missing arrestee and incident files from 2012
Vermont is missing 2012
West Virginia is missing 2012

In addition, I get an error for any Washington DC files and am unable to download anything from Georgia.

jeremiak commented 7 years ago

Thanks for this bug report @edrubin, we'll check it out

edrubin commented 7 years ago

The empty-zip-file issue seems to come in two flavors:

Upon unzipping, the folder is entirely empty (e.g., AL in 2012).
Upon unzipping, the folder contains the 6 NIBRS CSVs, but each CSV is empty (except for column names). Examples: AL, 1993–2005.

cacraig commented 6 years ago

We had released some fixes for this a week or two ago. I'm not sure if everything has been addressed on this list. I'm looking into it. Initially, it looks like 2012/2013 files are fixed.

18F / crime-data-explorer

Empty zip files from batch downloader (esp. 2012) #297