LBNL-UCB-STI / beam

The Framework for Modeling Behavior, Energy, Autonomy, and Mobility in Transportation Systems
https://transportation.lbl.gov/beam
Other
146 stars 57 forks source link

Create a new beam scenario for the Seattle city #3310

Closed heyrutvik closed 2 years ago

heyrutvik commented 3 years ago

Subtasks:

Instructions to create new scenario: https://ec2-18-116-117-142.us-east-2.compute.amazonaws.com/doku.php

heyrutvik commented 3 years ago

Information gathering

Local CRS (Coordinate Reference Systems):

Counties to consider (flow of workers)

Screenshot from 2021-09-20 21-23-45

synthpop:


CTPP [state]:

https://beam-outputs.s3.amazonaws.com/new_city/ctpp/wa.zip

TAZ [state]:

https://www2.census.gov/geo/tiger/TIGER2010/TAZ/2010/tl_2011_53_taz10.zip

BG (block group) [state]:

https://www2.census.gov/geo/tiger/TIGER2019/BG/tl_2019_53_bg.zip

County shapefile:

https://www2.census.gov/geo/tiger/TIGER2019/COUNTY/tl_2019_us_county.zip

state (.osm.pbf) file:

https://download.geofabrik.de/north-america/us/washington.html

GTFS data [city]:

https://transitfeeds.com/p/king-county-metro/73/latest (other resources: https://metro.kingcounty.gov/GTFS/)


Prepare data:

Congestion level data:
Conditional work duration:
State and county codes:
Off-peak speed (transform miles per hour into meters per second):

Notes:

  1. ~on scratching counties, the map end up too big to optimize. Either we can remove those counties or remove footway and residential from the map before running the osmnx script. (TODO)~
heyrutvik commented 3 years ago

scenario template folder (WIP)

repo: https://github.com/LBNL-UCB-STI/beam-data-seattle/tree/rrp/beam-issue-3310

heyrutvik commented 3 years ago

Current status: The map we cropped is too big to optimize. We may want to consider removing one (or two) of the counties included.

heyrutvik commented 3 years ago

Update: The optimization script doesn't spits out valid pbf file, even tried to reduce considered counties. Continuing with filtered pbf file for now.

heyrutvik commented 2 years ago

Summarizing work so far:

prototype: https://github.com/LBNL-UCB-STI/beam/compare/rrp/change-scenario-generator-to-create-blocks-csv-extended-border

  1. changes to generate blocks csv for urbansim_v2 inputs
  2. generate scenario files
  3. use python script to finalize csv formats
  4. changes in beam to use configured (beam parameter) linkRadiusMeters for split operations
  5. r5 changes to add public APIs to take linkRadiusMeters as method param, rather than predefined constant
heyrutvik commented 2 years ago

CRS: 32048

population count (see complete log):

Number of households: 1130405
Number of of people: 1760193

data repo: https://github.com/LBNL-UCB-STI/beam-data-seattle

1k population result: https://s3.us-east-2.amazonaws.com/beam-outputs/index.html#output/seattle/seattle__2022-01-24_06-35-08_sgk

doc edited:

  1. https://ec2-18-116-117-142.us-east-2.compute.amazonaws.com/doku.php?id=new_scenario_generation:prepare_scenario_generator
  2. https://ec2-18-116-117-142.us-east-2.compute.amazonaws.com/doku.php?id=new_scenario_generation:run_scenario_generator
zneedell commented 2 years ago

Just at first glance, the ratio of persons to households feels kinda low to me. Do these numbers include non-workers?

heyrutvik commented 2 years ago

@zneedell missed your comment earlier.

Do these numbers include non-workers?

No. These are after removing <16 age people and applying work force sampler. See following figures. 3967172 is the unfiltered number.

14:00:49.801 [main] INFO  b.u.d.synthpop.PopulationCorrection$ - Read 1530636 households with 3967172 people
14:00:49.904 [main] INFO  b.u.d.synthpop.PopulationCorrection$ - After filtering them got 1530624 households with 3141680 people.
Removed 12 households and 825492 people who are younger than 16
14:00:51.226 [main] INFO  b.u.d.synthpop.PopulationCorrection$ - After applying work force sampler got 1150136 households with 1797137 people.
Removed 380488 households and 1344543 people
14:00:52.816 [main] INFO  b.u.d.s.SimpleScenarioGenerator - Total number of households: 1150136
14:00:52.928 [main] INFO  b.u.d.s.SimpleScenarioGenerator - Total number of people: 1797137

Do we want to generate unfiltered population files just as we did for New York?

heyrutvik commented 2 years ago

These are after removing <16 age people. See following figures.

23:23:01.403 [main] INFO  b.u.d.synthpop.PopulationCorrection$ - Read 1530636 households with 3967172 people
23:23:01.476 [main] INFO  b.u.d.synthpop.PopulationCorrection$ - After filtering them got 1530624 households with 3141680 people.
Removed 12 households and 825492 people who are younger than 16
23:23:04.155 [main] INFO  b.u.d.s.SimpleScenarioGenerator - Total number of households: 1530624
23:23:04.239 [main] INFO  b.u.d.s.SimpleScenarioGenerator - Total number of people: 3141680

...

00:13:33.072 INFO  b.u.d.s.SimpleScenarioGenerator$ - Number of households: 1498174
00:13:33.519 INFO  b.u.d.s.SimpleScenarioGenerator$ - Number of of people: 3060577

plans s3 location: s3://beam-outputs/new_city/seattle/scenario_files_elderThan16Years_withoutWorkSampling/

heyrutvik commented 2 years ago

Closed by https://github.com/LBNL-UCB-STI/beam/pull/3451