[Bug]: SpannerIO.Write does not support named schemas - Githubissues

apache / beam

Apache Beam is a unified programming model for Batch and Streaming data processing.

https://beam.apache.org/

Apache License 2.0

7.89k stars 4.27k forks source link

[Bug]: SpannerIO.Write does not support named schemas #32907

Open nielm opened 1 month ago

nielm commented 1 month ago

What happened?

If named schemas are used in Spanner database, then SpannerIO does not know about tables created in that schema.

This leads to warnings during writes of the form:

Performance issue: Mutation references an unknown table: TABLENAME

Root cause is that SpannerIO.ReadSpannerSchema only reads information about tables in the default schema.

Issue Priority

Priority: 2 (default / most bugs should be filed as P2)

Issue Components

[ ] Component: Python SDK
[X] Component: Java SDK
[ ] Component: Go SDK
[ ] Component: Typescript SDK
[X] Component: IO connector
[ ] Component: Beam YAML
[ ] Component: Beam examples
[ ] Component: Beam playground
[ ] Component: Beam katas
[ ] Component: Website
[ ] Component: Infrastructure
[ ] Component: Spark Runner
[ ] Component: Flink Runner
[ ] Component: Samza Runner
[ ] Component: Twister2 Runner
[ ] Component: Hazelcast Jet Runner
[ ] Component: Google Cloud Dataflow Runner

nielm commented 1 month ago

.add-labels: gcp,io,spanner