hjohns12
commented
2 years ago I got the same error today, but when I checked the facility rows extracted by sorting alphabetically by Name, all the ones before "BEDFORD HILLS" are there. So I think this scraper is working as expected. BUT this error is confusing and keeps coming back up, so we should change something! But luckily I think the data extraction is working just fine :)
New York scraper from pdf (https://doccs.ny.gov/system/files/documents/2022/01/copy-of-incarceratedindividualdailycovid_table_forpio-2022.01.27_0.pdf) is started on line 10 -- likely a cropping issue. The log file (http://104.131.72.50:3838/scraper_data/log_files/2022-01-27_new_york.log) shows that the extraction is beginning on the Bedford Hills facility line, which is reflected in the extracted data.