search

O2-Czech-Republic / proxima-platform

The Proxima platform.
Apache License 2.0
18 stars 7 forks source link

Missing coder for PCollection #302

Closed je-ik closed 1 year ago

je-ik commented 1 year ago

batchSnapshot() under certain circumstances does not have coder:

ERROR java.lang.IllegalStateException:
Unable to return a default Coder for Flatten.PCollections.out [PCollection@308147762]. Correct one of the following root causes:
  No Coder has been manually specified;  you may do so using .setCoder().
  Using the default output Coder from the producing PTransform failed: PTransform.getOutputCoder called.
        at org.apache.beam.sdk.util.Preconditions.checkStateNotNull (Preconditions.java:471)
        at org.apache.beam.sdk.values.PCollection.getCoder (PCollection.java:284)
        at org.apache.beam.sdk.values.PCollection.finishSpecifying (PCollection.java:115)
        at org.apache.beam.sdk.runners.TransformHierarchy.finishSpecifyingInput (TransformHierarchy.java:154)
        at org.apache.beam.sdk.Pipeline.applyInternal (Pipeline.java:547)
        at org.apache.beam.sdk.Pipeline.applyTransform (Pipeline.java:482)
        at org.apache.beam.sdk.values.PCollection.apply (PCollection.java:360)
        at cz.o2.proxima.beam.core.BeamDataOperator.getBatchUpdates (BeamDataOperator.java:313)
        at cz.o2.proxima.beam.core.BeamDataOperator.getBatchUpdates (BeamDataOperator.java:263)
        at cz.o2.proxima.beam.core.BeamDataOperator.getBatchSnapshot (BeamDataOperator.java:391)
        at cz.o2.proxima.beam.tools.groovy.BeamStream.lambda$batchSnapshot$4 (BeamStream.java:235)
        at cz.o2.proxima.beam.tools.groovy.PCollectionProvider$ParentNotifyingProvider.materialize (PCollectionProvider.java:61)
        at cz.o2.proxima.beam.tools.groovy.PCollectionProvider$CachedPCollectionProvider.materialize (PCollectionProvider.java:77)
        at cz.o2.proxima.beam.tools.groovy.PCollectionProvider$ParentNotifyingProvider.materialize (PCollectionProvider.java:61)
        at cz.o2.proxima.beam.tools.groovy.PCollectionProvider$CachedPCollectionProvider.materialize (PCollectionProvider.java:77)
        at cz.o2.proxima.beam.tools.groovy.BeamStream.forEach (BeamStream.java:446)
        at cz.o2.proxima.beam.tools.groovy.BeamStream.forEach (BeamStream.java:441)
        at cz.o2.proxima.beam.tools.groovy.BeamStream.collect (BeamStream.java:565)
        at proxima_groovysh5.run (proxima_groovysh5:3)
        at cz.o2.proxima.tools.groovy.internal.ProximaInterpreter.evaluate (ProximaInterpreter.groovy:59)
        at cz.o2.proxima.tools.groovy.Console.runShell (Console.java:514)
        at cz.o2.proxima.tools.groovy.Console.run (Console.java:176)
        at cz.o2.proxima.tools.groovy.Console.main (Console.java:104)
je-ik commented 1 year ago

Closed via datadrivencz#795