search

radon-h2020 / radon-delivery-toolchain

Project listing all delivery toolchain requirements including: RADON orchestrator, Monitoring, Template Library, CI/CD.
Apache License 2.0
0 stars 4 forks source link

R-T5.4-10 Support Google BigQuery data warehouse as a data source when deploying data pipelines. #49

Open pjakovits opened 4 years ago

pjakovits commented 4 years ago
ID R-T5.4-10
Section WP5: Runtime environment
Type FUNCTIONAL_SUITABILITY
User Story As a Operations Engineer, I want to be able to design and deploy data pipelines which send or recieve data from Google BigQuery data warehouse.
Requirement Support Google BigQuery data warehouse as a data source when deploying data pipelines.
Extended Description The goal is support designing and deploying data pipeline applications which to use Google BigQuery data warehouse as a data source and data flow should be possible in both directions (consuming and producing into BigQuery).
Priority Should have
Affected Tools ORCHESTRATOR
Means of Verification Tests with data pipeline service template which includes Google BigQuery input and output data sources to verify that the data pipeline is deployed correctly.
pjakovits commented 4 years ago

New requirement. Please verify for approval @gcasale .

gcasale commented 4 years ago

Approved/

chinmaya-dehury commented 4 years ago

@cankarm , Can you please add "Data Pipeline" label to this issue?

cankarm commented 3 years ago

@chinmaya-dehury @pjakovits, what is the status on this? Is this still relevant?