search

ActivitySim / activitysim

An Open Platform for Activity-Based Travel Modeling
https://activitysim.github.io
BSD 3-Clause "New" or "Revised" License
189 stars 96 forks source link

output_tables function also write hdf5 if desired #278

Closed bstabler closed 4 years ago

bstabler commented 4 years ago

Provide automatic generation of simpler and more typical activity-based model output files such as the final household, person, tour, and trip files. (which basically means adding a CSV or HDF5 option to the output_tables function)

https://github.com/ActivitySim/activitysim/blob/master/example/configs/settings.yaml#L72

bettinardi commented 4 years ago

Hi Ben, I'm interested in following and reviewing this. I think we said that those that are closely following a topic would be assignees. I'm currently not an allowed editor on the activitySim github repo, so I can't add myself. What's the right course of action.? Can you add me?

joecastiglione commented 4 years ago

Alex,

We can make you an owner.

What's your github username?

Thanks,

Joe

blakerosenthal commented 4 years ago

Task Spec

The write_output_tables step currently only handles CSV outputs. We will add the option to write all tables into a single HDF5 store of pandas DataFrames via pandas.to_hdf. This option will be controlled in settings.yaml via a new subflag to output_tables called h5_store:

output_tables:
  h5_store: true
  action: include
  prefix: final_
  tables:
    - checkpoints
    ...