[Feature Request]: gRPC connector to Dataproc Metastore - Githubissues

apache / beam

Apache Beam is a unified programming model for Batch and Streaming data processing.

https://beam.apache.org/

Apache License 2.0

7.81k stars 4.23k forks source link

[Feature Request]: gRPC connector to Dataproc Metastore #29280

Open svetakvsundhar opened 11 months ago

svetakvsundhar commented 11 months ago

What would you like to happen?

We currently have HCatalog IO to read and write to a Hive store. Currently, this IO only has thrift support.

An IO that connects to a Hive DB/store such as GCP's Dataproc Metastore via gRPC would be a beneficial connector that currently isn't supported.

Issue Priority

Priority: 3 (nice-to-have improvement)

Issue Components

[ ] Component: Python SDK
[X] Component: Java SDK
[ ] Component: Go SDK
[ ] Component: Typescript SDK
[X] Component: IO connector
[ ] Component: Beam YAML
[ ] Component: Beam examples
[ ] Component: Beam playground
[ ] Component: Beam katas
[ ] Component: Website
[ ] Component: Spark Runner
[ ] Component: Flink Runner
[ ] Component: Samza Runner
[ ] Component: Twister2 Runner
[ ] Component: Hazelcast Jet Runner
[ ] Component: Google Cloud Dataflow Runner

svetakvsundhar commented 11 months ago

cc: @https://github.com/vicenteg