Gen3 schema - Githubissues

bmeg / bmeg-etl

ETL configuration for BMEG

1 stars 2 forks source link

Gen3 schema #331

Closed bwalsh closed 5 years ago

bwalsh commented 5 years ago

This PR reads scripts/bmeg-manifest.txt and creates:

python3 transform/gen3/schemas.py creates complete gen3 yaml schema files based on [*.Edge.json.gz, vertex.py]
python3 transform/gen3/load_postgres_vertices.py generates transform and load commands for all vertices

adamstruck commented 5 years ago

@bwalsh shouldn't this PR be against master?

kellrott commented 5 years ago

Is this still relevant?

bwalsh commented 5 years ago

The intent was to express bmeg into a gen3 native DB. Adam used it tactically in #332. Suggest closing it for now, but keep the branch in case we want to ETL directly to gen3 at some point in the future.

bwalsh commented 5 years ago

we used the output from this, saving here in case we need it