apache / beam

Apache Beam is a unified programming model for Batch and Streaming data processing.
https://beam.apache.org/
Apache License 2.0
7.85k stars 4.25k forks source link

[Failing Test]: JavaUsingPython postcommit tests are failing #29636

Open riteshghorse opened 10 months ago

riteshghorse commented 10 months ago

What happened?

Following task has been failing for last 2 runs with NullPointerException

> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerJavaUsingPython

org.apache.beam.runners.core.construction.ValidateRunnerXlangTest$SingleInputOutputTest > test FAILED
    org.apache.beam.vendor.grpc.v1p54p0.io.grpc.StatusRuntimeException at ValidateRunnerXlangTest.java:242
        Caused by: org.apache.beam.vendor.grpc.v1p54p0.io.netty.channel.AbstractChannel$AnnotatedConnectException
            Caused by: java.net.ConnectException at Errors.java:155
    java.lang.NullPointerException at Preconditions.java:1010

INFO:root:No image given, using default Python SDK image
INFO:root:Python SDK container image set to "apache/beam_python3.8_sdk:2.52.0" for Docker environment
INFO:__main__:Listening for expansion requests at 43129
INFO:root:Missing pipeline option (runner). Executing pipeline using the default runner: DirectRunner.
INFO:__main__:Shutting down expansion service.

> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerJavaUsingPython

org.apache.beam.sdk.extensions.python.transforms.PythonMapTest > testPythonMap FAILED
    java.lang.RuntimeException at PythonMapTest.java:41
        Caused by: java.util.concurrent.TimeoutException at PythonMapTest.java:41
    java.lang.NullPointerException at Preconditions.java:1010

org.apache.beam.sdk.extensions.python.transforms.DataframeTransformTest > testDataframeSum FAILED
    java.lang.RuntimeException at DataframeTransformTest.java:50
        Caused by: java.util.concurrent.TimeoutException at DataframeTransformTest.java:50
    java.lang.NullPointerException at Preconditions.java:1010

org.apache.beam.sdk.extensions.python.transforms.RunInferenceTransformTest > testRunInferenceWithKVs FAILED
    java.lang.RuntimeException at RunInferenceTransformTest.java:108
        Caused by: java.util.concurrent.TimeoutException at RunInferenceTransformTest.java:108
    java.lang.NullPointerException at Preconditions.java:1010

org.apache.beam.sdk.extensions.python.transforms.PythonMapTest > testPythonFlatMap FAILED
    java.lang.RuntimeException at PythonMapTest.java:54
        Caused by: java.util.concurrent.TimeoutException at PythonMapTest.java:54
    java.lang.NullPointerException at Preconditions.java:1010

org.apache.beam.sdk.extensions.python.transforms.RunInferenceTransformTest > testRunInference FAILED
    java.lang.RuntimeException at RunInferenceTransformTest.java:60
        Caused by: java.util.concurrent.TimeoutException at RunInferenceTransformTest.java:60
    java.lang.NullPointerException at Preconditions.java:1010

16 tests completed, 6 failed

Issue Failure

Failure: Test is flaky

Issue Priority

Priority: 1 (unhealthy code / failing or flaky postcommit so we cannot be sure the product is healthy)

Issue Components

riteshghorse commented 10 months ago

https://ci-beam.apache.org/job/beam_PostCommit_XVR_JavaUsingPython_Dataflow/

Moving to P2 since it says that This project is currently disabled (shouldn't be though)