Closed siddhanta-rath closed 1 month ago
The pom file has both
<flink.artifact.name>beam-runners-flink-1.16</flink.artifact.name>
<flink.artifact.name>beam-runners-flink-1.18</flink.artifact.name>
likely 1.18 beam-flink-runner is used on 1.16 backend.
Flink runner is running fine on tests and this is likely not a beam issue. I'm closing this for now. A few things to check
mvn dependency:tree
)if issue persists, feel free to reopen
What happened?
I have used the below official documentation to run the beam word count example : https://beam.apache.org/get-started/quickstart-java/
I have installed
flink 1.16.2
version and running it on my local at 8081 port. I am using the latest beam SDK2.58.0
version and addedbeam-runners-flink-1.16
dependency in thepom.xml
I have used the below command to deploy the beam job on flink runner:
mvn package exec:java -Dexec.mainClass=org.example.WordCount \ -Dexec.args="--runner=FlinkRunner --flinkMaster=localhost:8081 --filesToStage=target/word-count-beam-in-new-bundled-1.0-SNAPSHOT.jar \ --inputFile=/Users/siddhantarath/sample-beam-wordcount/word-count-beam-in-new/sample.txt --output=/tmp/counts" -Pflink-runner
the task manager is crashing and getting below errors:
pom.xml:
Issue Priority
Priority: 2 (default / most bugs should be filed as P2)
Issue Components