Combine write to datalake code for ActivitySim models and report folder.
ActivitySim calls a new extension "update_tables" to make changes to the output tables before exporting locally as csv with "write_tables". Emme master run calls a python 3 script at the end of the run which reads csv files from "output/modelname" and "report" and writes them to datalake as parquet. Improvements are made to the scenario metadata table, and the .properties file for the run is also written to the datalake.
Combine write to datalake code for ActivitySim models and report folder.
ActivitySim calls a new extension "update_tables" to make changes to the output tables before exporting locally as csv with "write_tables". Emme master run calls a python 3 script at the end of the run which reads csv files from "output/modelname" and "report" and writes them to datalake as parquet. Improvements are made to the scenario metadata table, and the .properties file for the run is also written to the datalake.
AB#427 AB#439 AB#448 AB#454