In the pipeline.py script within monarch_ingest, we should assume that if the output kgx files already exist, the pipeline doesn't need to re-transform those files. There should be a --force-transform option to specifically ask for the transform(s) to run even if the output kgx exists.
(why not just --force? we should have --force-* options for each stage, like a --force-merge and other steps, and then we can use --force to force all of the steps)
In the pipeline.py script within monarch_ingest, we should assume that if the output kgx files already exist, the pipeline doesn't need to re-transform those files. There should be a --force-transform option to specifically ask for the transform(s) to run even if the output kgx exists.
(why not just --force? we should have --force-* options for each stage, like a --force-merge and other steps, and then we can use --force to force all of the steps)