Open eecavanna opened 1 month ago
As discussed on Slack, I'm thinking of there being a helper function (a.k.a. a "util" function) that generates the alldocs
collection (I called this function "compile_alldocs_collection
" in the diagram below). The Dagster op and the bulk referential integrity validation notebook would then each "import" that helper function insteading of having their own local implementation (which could fall "out of sync" with the other's over time).
Originally posted by @PeopleMakeCulture in https://github.com/microbiomedata/nmdc-runtime/issues/694#issuecomment-2364123504