search

SignifAi / Spark-PubSub

Google Cloud Pubsub connector for Spark Streaming
Apache License 2.0
16 stars 3 forks source link

Could not resolve dependencies for project #7

Open Amglsox opened 3 years ago

Amglsox commented 3 years ago

I am trying to get this library and not having any luck... Appreciate any help! When executing the mvn clean install command inside the java directory, I am receiving this error below:

Captura de Tela 2020-12-23 às 12 05 11

anguillanneuf commented 2 years ago

@Amglsox Not sure if you kept trying. I updated <spark.version>2.3.2</spark.version> to 2.4.7 and also added <maven.findbugs.plugin>4.4.2</maven.findbugs.plugin> in the POM file. After that, mvn clean install built cleanly. I was able to run the PySpark example in the README too (just remember to set decodeData to true as the fourth required argument in PubsubUtils.createStream(ssc, SUBSCRIPTION, 5).

https://github.com/SignifAi/Spark-PubSub/blob/c4fe9c65d495075208ad56988d71265fd9bfdb81/java/pom.xml#L87