Step 1: Swap in new parcels, and update tables that rely on it (join to it)
Move away from the H5 datastore
read in csvs for parcels, buildings, households, and jobs
remove the orca tables for their "preprocessed" versions since we will only have one version of each going forward
remove configs/paths which only held the path to find the h5 for use in the code
Remove code no longer needed with new parcels dataset
geom_id_to_parcel_id and parcel_id_to_geom_id functions and use of them
Bring in the single table for zoning_existing parcel level information, removing zoning_lookup and zoning_parcels
Update the parcels join key on other tables that are not being updated with this base year data update, such as zoning_strategy
Update parcels_geography table to growth_geographies table, removing BAUS edits and columns that are held in the inputs, such as juris_tra (concatenated juris + tra column)
Update development projects table
remove the reprocess_dev_projects function since that shifts duplicate projects to "add" to the parcel, do this on the inputs side (this also create a fourth dev projects function making it harder to track what happens to these projects)
move the editing of this table into the BASIS side as well
Update nodev
Remove manual_nodev and parcels_rejections (which it reads in), since these should be fed in through BASIS if carried forward
Transition nodev code from a collection of sources (zoning, static parcels, sea level rise parcels), to columns that can be pulled from the BASIS nodev table:
Remove "nodev from zoning" which @yuqiww found is a duplication of the nodev parcel column
The nodev column now only reads from the BASIS nodev table, then adds "static parcels" (including Institutions) to the list.
Relatedly, transition the parcel_filter for parcel development consideration from a collection of sources (nodev, pipeline projects, rules on which parcel/building types can be developed), to columns that can be pulled from the BASIS nodev table.
Remove filters on building age, small-lot single family parcels, ad building type
The parcel filter now only filters out nodev parcels and development pipeline projects
Move the preprocessing.py logic that makes parking building types off limits in to nodev as well
Remove mapping.py
More building mapping into developer_settings.yaml
Other mappings like naics_to_empsix are no longer needed since we're using empsix throughout the inputs and code-- --- - Update calculate_vmt_fees and calculate_jobs_housing_fees which use parcels and other geography columns
To see the specific tasks where the Asana app for GitHub is being used, see below:
Step 1: Swap in new parcels, and update tables that rely on it (join to it)
configs/pathswhich only held the path to find the h5 for use in the codegeom_id_to_parcel_idandparcel_id_to_geom_idfunctions and use of themzoning_existingparcel level information, removingzoning_lookupandzoning_parcelszoning_strategyparcels_geographytable togrowth_geographiestable, removing BAUS edits and columns that are held in the inputs, such asjuris_tra(concatenated juris + tra column)reprocess_dev_projectsfunction since that shifts duplicate projects to "add" to the parcel, do this on the inputs side (this also create a fourth dev projects function making it harder to track what happens to these projects)manual_nodevandparcels_rejections(which it reads in), since these should be fed in through BASIS if carried forwardnodevcolumn now only reads from the BASIS nodev table, then adds "static parcels" (including Institutions) to the list.parcel_filterfor parcel development consideration from a collection of sources (nodev, pipeline projects, rules on which parcel/building types can be developed), to columns that can be pulled from the BASIS nodev table.mapping.pynaics_to_empsixare no longer needed since we're using empsix throughout the inputs and code-- --- - Update calculate_vmt_fees and calculate_jobs_housing_fees which use parcels and other geography columns