search

apache / beam

Apache Beam is a unified programming model for Batch and Streaming data processing.
https://beam.apache.org/
Apache License 2.0
7.9k stars 4.27k forks source link

The PostCommit XVR Samza job is flaky #30601

Open github-actions[bot] opened 8 months ago

github-actions[bot] commented 8 months ago

The PostCommit XVR Samza is failing over 50% of the time Please visit https://github.com/apache/beam/actions/workflows/beam_PostCommit_XVR_Samza.yml?query=is%3Afailure+branch%3Amaster to see the logs.

github-actions[bot] commented 6 months ago

Reopening since the workflow is still flaky

github-actions[bot] commented 6 months ago

Reopening since the workflow is still flaky

Abacn commented 6 months ago

looks like thus time the breakage is due to python3.12 support:

File "/tmp/bootstrap_beam_venv7899546459285591331.py", line 33, in from pkg_resources import parse_version ModuleNotFoundError: No module named 'pkg_resources'

Abacn commented 6 months ago

The error is found elsewhere: https://github.com/ManimCommunity/manim/issues/3585 and is said to due to https://peps.python.org/pep-0668/ .

github-actions[bot] commented 1 week ago

Reopening since the workflow is still flaky

Abacn commented 6 days ago

Single test failing - test_zetasql_generate_data. This is due to zetasql version bump #32902 . Samza test can only run on Java8, while newer zetasql does not support Java8

apache_beam.utils.subprocess_server:subprocess_server.py:213 Exception in thread "grpc-default-executor-0" java.lang.NoSuchMethodError: java.util.Map.entry(Ljava/lang/Object;Ljava/lang/Object;)Ljava/util/Map$Entry;
    at com.google.zetasql.Type.<clinit>(Type.java:55)
    at com.google.zetasql.TypeFactory$1.apply(TypeFactory.java:123)
    at com.google.zetasql.TypeFactory$1.apply(TypeFactory.java:120)
    at com.google.common.collect.Maps.toMap(Maps.java:1277)
    at com.google.common.collect.Maps.toMap(Maps.java:1255)
    at com.google.zetasql.TypeFactory.<clinit>(TypeFactory.java:118)
    at com.google.zetasql.AllowedHintsAndOptions.addDefaultAnonymizationOptions(AllowedHintsAndOptions.java:564)
    at com.google.zetasql.AllowedHintsAndOptions.<init>(AllowedHintsAndOptions.java:107)
    at com.google.zetasql.AnalyzerOptions.<init>(AnalyzerOptions.java:59)
    at org.apache.beam.sdk.extensions.sql.zetasql.SqlAnalyzer.baseAnalyzerOptions(SqlAnalyzer.java:138)
Abacn commented 6 days ago

Map.entry is an API for Java 9+

https://docs.oracle.com/en/java/javase/11/docs/api/java.base/java/util/Map.html#entry(K,V)

Update: opened #33213 for fix