search

transitland / gtfs

Ruby library for dealing with GTFS. Used by Transitland's FeedEater import pipeline.
8 stars 6 forks source link

Improve handling of improperly escaped CSV quotes #70

Closed irees closed 7 years ago

irees commented 7 years ago

For example:

M1119,MTA NYCT,M1119,"M" Shuttle Myrtle Av - Fresh Pond Rd or Metropolitan Av,via Myrtle Av/Metropolitan Av,3,http://web.mta.info/nyct/bus/schedule/bkln/m1119cur.pdf, 006CB7,FFFFFF

Try to recover by first removing quotes, then by skipping the row if it can't be fixed. Add option to also skip if this results in a row with a differing number of columns.