Missing Data

[JamyiaClark]

Year 2000 data for teen births is missing.

[derekeder]

@JamyiaClark I noticed this as well. There are several datasets that seem to be missing data and confidence intervals. This is probably due to the column names and the programatic way I am importing the data. See #10. Also related to #21.

I will work to get a list of specific columns that my scripts are failing to import.

[derekeder]

@JamyiaClark I ran a few tests to isolate the columns we are failing to import. Most of them were simple to work around, like extra spaces and the presence or absence of a simple term at the end (like CI).

The only one I couldn't find a good workaround for was Teen Birth Rate. Between 1999 and 2003 the confidence intervals are labeled 'Birth Rate [year] Lower CI' and from 2004 they are labeled 'Teen Birth Rate [year] Lower CI'. Could this be fixed on your end?

[JamyiaClark]

I will address this issue. Basically, what you are saying is that there are discrepancies in column headings within a dataset or discrepancies in column headings across all datasets?

[derekeder]

Thanks Jamyia! Please just fix the following:

• column headings for confidence intervals for Teen Birth Rate 1993-2003 (missing 'Teen' at the beginning)
• column heading for confidence intervals for Pre-term Births 1999 (missing 'CI' at the end)

[JamyiaClark]

The columns have been corrected

[derekeder]

Thanks Jamyia. I see the column headers have been updated in the data portal view mode, but for some reason when you download the data the old names remain.

I wonder if this is a caching issue with Socrata. I'll try again after some time to see if that's the case.

[JamyiaClark]

Good Morning Derek, Were you able to get those datasets to import correctly? I’m not sure what’s going on with them. I tried to troubleshoot the problem on my end, but I couldn’t recognize anything that would cause them to retain the same column headings.

-Jamyia

From: Derek Eder [mailto:notifications@github.com] Sent: Thursday, March 28, 2013 12:30 PM To: smartchicago/chicago-atlas Cc: Clark, Jamyia Subject: Re: [chicago-atlas] Missing Data (#26)

Thanks Jamyia. I see the column headers have been updated in the data portal view mode, but for some reason when you download the data the old names remain.

I wonder if this is a caching issue with Socrata. I'll try again after some time to see if that's the case.

— Reply to this email directly or view it on GitHubhttps://github.com/smartchicago/chicago-atlas/issues/26#issuecomment-15602332.

---

This e-mail, and any attachments thereto, is intended only for use by the addressee(s) named herein and may contain legally privileged and/or confidential information. If you are not the intended recipient of this e-mail (or the person responsible for delivering this document to the intended recipient), you are hereby notified that any dissemination, distribution, printing or copying of this e-mail, and any attachment thereto, is strictly prohibited. If you have received this e-mail in error, please respond to the individual sending the message, and permanently delete the original and any copy of any e-mail and printout thereof.

[derekeder]

I checked again and it looks like the change went through! Did a fresh import and the confidence intervals for Teen Births are showing up now: http://www.chicagohealthatlas.org/place/east_garfield_park