search

UK-IPOP / open-data-pipeline

A pipeline for processing, enhancing, and sharing open datasets.
https://uk-ipop.github.io/open-data-pipeline/
GNU General Public License v3.0
1 stars 0 forks source link

pipeline #46

Open cdelcher opened 1 week ago

cdelcher commented 1 week ago

having some trouble with importing the CSV file with SAS and I think it may be unpredictable comma issues in free text. how difficult would it be to create pipedelimited versions too?

nanthony007 commented 1 week ago

Which csv file is this referring to @cdelcher?

cdelcher commented 1 week ago

I noticed in Milwaukee but haven’t checked the others closely. Chris Delcher, PhD

On Nov 15, 2024, at 12:39 PM, Nick Anthony @.***> wrote:

 CAUTION: External Sender

Which csv file is this referring to @cdelcherhttps://github.com/cdelcher?

— Reply to this email directly, view it on GitHubhttps://github.com/UK-IPOP/open-data-pipeline/issues/46#issuecomment-2479558161, or unsubscribehttps://github.com/notifications/unsubscribe-auth/ALKB46ZGVDPQDU7AUIHBPET2AYWWPAVCNFSM6AAAAABR3S5W4SVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDINZZGU2TQMJWGE. You are receiving this because you were mentioned.Message ID: @.***>

cdelcher commented 6 days ago

the pipe doesn't work either but I think I've narrowed down the issue and its just in Milwaukee right now. Any time quotes appear in any of the cause of death fields, the record does not read in properly. i've eye balled various records and that seems to be consistent.

nanthony007 commented 4 days ago

Have we come around on this?