search

GoogleCloudPlatform / DataflowTemplates

Cloud Dataflow Google-provided templates for solving in-Cloud data tasks
https://cloud.google.com/dataflow/docs/guides/templates/provided-templates
Apache License 2.0
1.15k stars 966 forks source link

PubSub to BigQuery partitioned table #37

Closed NeoCN closed 4 months ago

NeoCN commented 5 years ago

Is there any plan to add PubSub to BigQuery partitioned table template?

azurezyq commented 5 years ago

Aare you talking about BigQueryIO.withTimePartitioning? Yes, we can support that and will provide more updates when we begin working on it.

damienhollis commented 2 years ago

@azurezyq any progress on this?

We are using https://cloud.google.com/dataflow/docs/guides/templates/provided-streaming#datastream-to-bigquery and we'd like to partition and cluster the tables but we don't want to have to manually create the tables if we can avoid it.

azurezyq commented 2 years ago

I'm no longer working on Dataflow. Sorry.

github-actions[bot] commented 4 months ago

This issue has been marked as stale due to 180 days of inactivity. It will be closed in 1 week if no further activity occurs. If you think that’s incorrect or this pull request requires a review, please simply write any comment. If closed, you can revive the issue at any time. Thank you for your contributions.

github-actions[bot] commented 4 months ago

This issue has been closed due to lack of activity. If you think that is incorrect, or the pull request requires review, you can revive the PR at any time.