search

samelamin / spark-bigquery

Google BigQuery support for Spark, Structured Streaming, SQL, and DataFrames with easy Databricks integration.
Apache License 2.0
70 stars 28 forks source link

[Proposal] add sbt-coursier #58

Closed smdmts closed 6 years ago

smdmts commented 6 years ago

Hi, I'm facing unresolved dependencies with unknown error but sbt-coursier (https://github.com/coursier/coursier) works well. So this is proposal P/R and how do you feel?

[warn]  ::::::::::::::::::::::::::::::::::::::::::::::
[warn]  ::          UNRESOLVED DEPENDENCIES         ::
[warn]  ::::::::::::::::::::::::::::::::::::::::::::::
[warn]  :: net.jcip#jcip-annotations;1.0: net.jcip#jcip-annotations;1.0!jcip-annotations.pom(pom.original) origin location must be absolute: file:/Users/smdmts/.m2/repository/net/jcip/jcip-annotations/1.0/jcip-annotations-1.0.pom
[warn]  :: net.minidev#json-smart;1.1.1: net.minidev#json-smart;1.1.1!json-smart.pom(pom.original) origin location must be absolute: file:/Users/smdmts/.m2/repository/net/minidev/json-smart/1.1.1/json-smart-1.1.1.pom
[warn]  ::::::::::::::::::::::::::::::::::::::::::::::
[warn] 
[warn]  Note: Unresolved dependencies path:
[warn]          net.jcip:jcip-annotations:1.0 (/Users/smdmts/git/oss/spark-bigquery/build.sbt#L30-46)
[warn]            +- com.nimbusds:nimbus-jose-jwt:3.9
[warn]            +- org.apache.hadoop:hadoop-auth:2.8.1
[warn]            +- org.apache.hadoop:hadoop-common:2.8.1
[warn]            +- org.apache.hadoop:hadoop-client:2.8.1
[warn]            +- com.holdenkarau:spark-testing-base_2.11:2.2.0_0.8.0 (/Users/smdmts/git/oss/spark-bigquery/build.sbt#L30-46)
[warn]            +- com.github.samelamin:spark-bigquery_2.11:0.2.4
[warn]          net.minidev:json-smart:1.1.1 (/Users/smdmts/git/oss/spark-bigquery/build.sbt#L30-46)
[warn]            +- com.nimbusds:nimbus-jose-jwt:3.9
[warn]            +- org.apache.hadoop:hadoop-auth:2.8.1
[warn]            +- org.apache.hadoop:hadoop-common:2.8.1
[warn]            +- org.apache.hadoop:hadoop-client:2.8.1
[warn]            +- com.holdenkarau:spark-testing-base_2.11:2.2.0_0.8.0 (/Users/smdmts/git/oss/spark-bigquery/build.sbt#L30-46)
[warn]            +- com.github.samelamin:spark-bigquery_2.11:0.2.4
samelamin commented 6 years ago

Thanks for the help @smdmts

What exactly is the error you are seeing when you try to build the library with SBT?

I think only you faced this issue before so might be only specified to your machine setup, I have never used coursier but happy to merge it in if it adds value