gcs_to_bq - a flow that takes a list of GS uris, and creates a single dataset with linked tables underneath - each table linked to a uri.
Updates:
The following register_flow files:
gcs_folder_to_bq - conforming to new config object.
The following run_flow files:
cbs_helper - adding a first implementation of gcs_to_bq. This script is not ready, and perhaps should be reconsidered from a content point of view. The flow-of-flows implemetation is not working there either.
This PR:
register_flowfiles:gcs_to_bq- a flow that takes a list of GS uris, and creates a single dataset with linked tables underneath - each table linked to a uri.register_flowfiles:gcs_folder_to_bq- conforming to new config object.run_flowfiles:cbs_helper- adding a first implementation ofgcs_to_bq. This script is not ready, and perhaps should be reconsidered from a content point of view. The flow-of-flows implemetation is not working there either.get_gcs_uristo utilscloses #48