apache / beam

Apache Beam is a unified programming model for Batch and Streaming data processing.
https://beam.apache.org/
Apache License 2.0
7.88k stars 4.26k forks source link

[Task]: SpannerIO add more logging when Reads fail #29638

Closed nielm closed 11 months ago

nielm commented 11 months ago

What needs to happen?

Currently failing reads just throw a SpannerException, without any information about which particular read operation failed. Sometimes due to the way Spanner separates the read API call from the row retrieval, you cannot see from the exception what table/query caused the read to fail.

And an error log to indicate which table /query result was being read when the failure occurred.

Issue Priority

Priority: 3 (nice-to-have improvement)

Issue Components

nielm commented 11 months ago

.take-issue .add-labels gcp,spanner