Open damccorm opened 2 years ago
Any updated on this? It's an amazingly annoying bug.
Also keen on an update. Should this be here or is it more of a Google thing to fix?
.take-issue
I've just realised the step_id
is only missing for logs in the DoFn.setup
. Logs in process
do appear to have it set correctly for me. It is less of an issue but would be nice to have it in the setup as well.
Any update on this? :)
Using the dataflow runner, log messages always show up in stackdriver with the step_id as the empty string, so filtering log messages for a step doesn't work.
Another user seems to have posted in the old github repo and appears to be seeing the same problem based on their output:
https://github.com/GoogleCloudPlatform/DataflowPythonSDK/issues/62
From what I can tell is only affecting streaming pipelines
Imported from Jira BEAM-7934. Original Jira may contain additional context. Reported by: jimpremise.