The 1.2.2 version was updated for Scala 2.13 and Spark 3.2.1 but there was a conflict on the Scala build because of "Conflicting cross-version suffixes in: org.apache.spark:spark-tags"
The error logs is given below:
[error] Modules were resolved with conflicting cross-version suffixes in ProjectRef(...):
[error] org.apache.spark:spark-tags _2.13, _2.12
[error] stack trace is suppressed; run 'last update' for the full output
[error] stack trace is suppressed; run 'last ssExtractDependencies' for the full output
[error] (update) Conflicting cross-version suffixes in: org.apache.spark:spark-tags
[error] (ssExtractDependencies) Conflicting cross-version suffixes in: org.apache.spark:spark-tags
I have updated pom to use Scala Binary version 2.13 and changed the tag to 1.2.3 and updated the Scala code to handle changes. The Test cases are passing and now this new jar runs without any conflicts for spark streaming in my codebase
The 1.2.2 version was updated for Scala 2.13 and Spark 3.2.1 but there was a conflict on the Scala build because of "Conflicting cross-version suffixes in: org.apache.spark:spark-tags" The error logs is given below:
I have updated pom to use Scala Binary version 2.13 and changed the tag to 1.2.3 and updated the Scala code to handle changes. The Test cases are passing and now this new jar runs without any conflicts for spark streaming in my codebase