search

mikejohnson51 / hydrofab

Hydrofabric Fabricator
Creative Commons Zero v1.0 Universal
9 stars 4 forks source link

Need to create a national dataset from VPUs #5

Closed mikejohnson51 closed 2 years ago

mikejohnson51 commented 2 years ago

There is a need to merge VPU level gpkgs into a national dataset. This requires the following three things:

  1. Create nationally unique identifiers for all features
  2. Reassign the ID and toIDs across all data layers
  3. Ensure that cross-VPU flows are accounted for (e.g. VPU 1OU flow to 10L)

In the nextgen workflow this will be applied as a first step on the uniform aggregation artifacts before being passed on to the nexus_topology creation. There is a chance that the cross VPU flows will cause the nexus topology to error out since - from the VPU perspective - data is flowing to an ID that "doesn't" exist.

EDITS:

mikejohnson51 commented 2 years ago

This has been mostly resolved, but right now some ids are getting cast to scientific notation (e.g. cat-3e+05). Need a forced numeric conversion prior to appending prefix.