read tab separated files in addition to csv

[bstabler]

Daysim writes tsv by default. Please expose the pandas read csv sep argument in the settings.yaml file

http://pandas.pydata.org/pandas-docs/stable/generated/pandas.read_csv.html

[toliwaga]

Just to understand the problem, which files, specifically, might be tab delimited? And if one is, will all be?

all csv files (surely not the config files?)

presumably these: base_households.csv basetrips_buildlos.csv basetrips_normal.csv build_households.csv buildtrips_baselos.csv buildtrips_normal.csv persons.csv

how about: link manifest? link files?

[mabcal]

Yes the ones you list under “presumably these”, and maybe the link files as well (but not the link manifest). You could set the delimiter based off the extension -- .tsv means tab, .csv means comma, .txt means space. Basically, anything that’s listed as an input file in the config files, except the .omx matrices.

Mark

From: Jeff Doyle [mailto:notifications@github.com] Sent: Friday, June 10, 2016 5:32 AM To: RSGInc/bca4abm bca4abm@noreply.github.com Subject: Re: [RSGInc/bca4abm] read tab separated files in addition to csv (#60)

Just to understand the problem, which files, specifically, might be tab delimited? And if one is, will all be?

all csv files (surely not the config files?)

presumably these: base_households.csv basetrips_buildlos.csv basetrips_normal.csv build_households.csv buildtrips_baselos.csv buildtrips_normal.csv persons.csv

how about: link manifest? link files?

— You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHubhttps://github.com/RSGInc/bca4abm/issues/60#issuecomment-225169661, or mute the threadhttps://github.com/notifications/unsubscribe/AOwsPMQrjN4J0mYSq9NlOTT01oxMFcc4ks5qKVk2gaJpZM4IydIH.

[toliwaga]

sounds good. I am assuming there is no escaping of any kind?

how should quotes be handled - passed through as literals, I presume?

[toliwaga]

fixed