LucaCanali / sparkMeasure

This is the development repository for sparkMeasure, a tool and library designed for efficient analysis and troubleshooting of Apache Spark jobs. It focuses on easing the collection and examination of Spark metrics, making it a practical choice for both developers and data engineers.
Apache License 2.0
690 stars 144 forks source link

Issue when using sbt dependency - retrofit not resolved #47

Closed AnirudhVyas closed 1 year ago

AnirudhVyas commented 1 year ago

I get following error as I try to import sparkMeasure to my project:

[SUCCESSFUL ] ch.cern.sparkmeasure#spark-measure_2.12;0.22!spark-measure_2.12.jar (190ms)
[warn]  ::::::::::::::::::::::::::::::::::::::::::::::
[warn]  ::          UNRESOLVED DEPENDENCIES         ::
[warn]  ::::::::::::::::::::::::::::::::::::::::::::::
[warn]  :: com.squareup.retrofit2#retrofit;2.4.0: Resolution failed several times for dependency: com.squareup.retrofit2#retrofit;2.4.0 {compile=[compile(*), master(*)], runtime=[runtime(*)]}::
[warn]  com.squareup.retrofit2#retrofit;2.4.0!retrofit.pom(pom.original) origin location must be absolute: file:/Users/anirudh.vyas/.m2/repository/com/squareup/retrofit2/retrofit/2.4.0/retrofit-2.4.0.pom
[warn]  com.squareup.retrofit2#retrofit;2.4.0!retrofit.pom(pom.original) origin location must be absolute: file:/Users/anirudh.vyas/.m2/repository/com/squareup/retrofit2/retrofit/2.4.0/retrofit-2.4.0.pom
[warn]  com.squareup.retrofit2#retrofit;2.4.0!retrofit.pom(pom.original) origin location must be absolute: file:/Users/anirudh.vyas/.m2/repository/com/squareup/retrofit2/retrofit/2.4.0/retrofit-2.4.0.pom
[warn]  com.squareup.retrofit2#retrofit;2.4.0!retrofit.pom(pom.original) origin location must be absolute: file:/Users/anirudh.vyas/.m2/repository/com/squareup/retrofit2/retrofit/2.4.0/retrofit-2.4.0.pom
[warn]  :: com.squareup.retrofit2#converter-moshi;2.4.0: Resolution failed several times for dependency: com.squareup.retrofit2#converter-moshi;2.4.0 {compile=[compile(*), master(*)], runtime=[runtime(*)]}::
[warn]  Resolution failed several times for dependency: com.squareup.retrofit2#retrofit-converters;2.4.0 {}::
[warn]  com.squareup.retrofit2#retrofit-converters;2.4.0!retrofit-converters.pom(pom.original) origin location must be absolute: file:/Users/anirudh.vyas/.m2/repository/com/squareup/retrofit2/retrofit-converters/2.4.0/retrofit-converters-2.4.0.pom
[warn]  com.squareup.retrofit2#retrofit-converters;2.4.0!retrofit-converters.pom(pom.original) origin location must be absolute: file:/Users/anirudh.vyas/.m2/repository/com/squareup/retrofit2/retrofit-converters/2.4.0/retrofit-converters-2.4.0.pom
[warn]  com.squareup.retrofit2#retrofit-converters;2.4.0!retrofit-converters.pom(pom.original) origin location must be absolute: file:/Users/anirudh.vyas/.m2/repository/com/squareup/retrofit2/retrofit-converters/2.4.0/retrofit-converters-2.4.0.pom
[warn]  com.squareup.retrofit2#retrofit-converters;2.4.0!retrofit-converters.pom(pom.original) origin location must be absolute: file:/Users/anirudh.vyas/.m2/repository/com/squareup/retrofit2/retrofit-converters/2.4.0/retrofit-converters-2.4.0.pom
[warn]
[warn]  Resolution failed several times for dependency: com.squareup.retrofit2#retrofit-converters;2.4.0 {}::
[warn]  com.squareup.retrofit2#retrofit-converters;2.4.0!retrofit-converters.pom(pom.original) origin location must be absolute: file:/Users/anirudh.vyas/.m2/repository/com/squareup/retrofit2/retrofit-converters/2.4.0/retrofit-converters-2.4.0.pom
[warn]  com.squareup.retrofit2#retrofit-converters;2.4.0!retrofit-converters.pom(pom.original) origin location must be absolute: file:/Users/anirudh.vyas/.m2/repository/com/squareup/retrofit2/retrofit-converters/2.4.0/retrofit-converters-2.4.0.pom
[warn]  com.squareup.retrofit2#retrofit-converters;2.4.0!retrofit-converters.pom(pom.original) origin location must be absolute: file:/Users/anirudh.vyas/.m2/repository/com/squareup/retrofit2/retrofit-converters/2.4.0/retrofit-converters-2.4.0.pom
[warn]  com.squareup.retrofit2#retrofit-converters;2.4.0!retrofit-converters.pom(pom.original) origin location must be absolute: file:/Users/anirudh.vyas/.m2/repository/com/squareup/retrofit2/retrofit-converters/2.4.0/retrofit-converters-2.4.0.pom
[warn]
[warn]  Resolution failed several times for dependency: com.squareup.retrofit2#retrofit-converters;2.4.0 {}::
[warn]  com.squareup.retrofit2#retrofit-converters;2.4.0!retrofit-converters.pom(pom.original) origin location must be absolute: file:/Users/anirudh.vyas/.m2/repository/com/squareup/retrofit2/retrofit-converters/2.4.0/retrofit-converters-2.4.0.pom
[warn]  com.squareup.retrofit2#retrofit-converters;2.4.0!retrofit-converters.pom(pom.original) origin location must be absolute: file:/Users/anirudh.vyas/.m2/repository/com/squareup/retrofit2/retrofit-converters/2.4.0/retrofit-converters-2.4.0.pom
[warn]  com.squareup.retrofit2#retrofit-converters;2.4.0!retrofit-converters.pom(pom.original) origin location must be absolute: file:/Users/anirudh.vyas/.m2/repository/com/squareup/retrofit2/retrofit-converters/2.4.0/retrofit-converters-2.4.0.pom
[warn]  com.squareup.retrofit2#retrofit-converters;2.4.0!retrofit-converters.pom(pom.original) origin location must be absolute: file:/Users/anirudh.vyas/.m2/repository/com/squareup/retrofit2/retrofit-converters/2.4.0/retrofit-converters-2.4.0.pom
[warn]
[warn]  Resolution failed several times for dependency: com.squareup.retrofit2#retrofit-converters;2.4.0 {}::
[warn]  com.squareup.retrofit2#retrofit-converters;2.4.0!retrofit-converters.pom(pom.original) origin location must be absolute: file:/Users/anirudh.vyas/.m2/repository/com/squareup/retrofit2/retrofit-converters/2.4.0/retrofit-converters-2.4.0.pom
[warn]  com.squareup.retrofit2#retrofit-converters;2.4.0!retrofit-converters.pom(pom.original) origin location must be absolute: file:/Users/anirudh.vyas/.m2/repository/com/squareup/retrofit2/retrofit-converters/2.4.0/retrofit-converters-2.4.0.pom
[warn]  com.squareup.retrofit2#retrofit-converters;2.4.0!retrofit-converters.pom(pom.original) origin location must be absolute: file:/Users/anirudh.vyas/.m2/repository/com/squareup/retrofit2/retrofit-converters/2.4.0/retrofit-converters-2.4.0.pom
[warn]  com.squareup.retrofit2#retrofit-converters;2.4.0!retrofit-converters.pom(pom.original) origin location must be absolute: file:/Users/anirudh.vyas/.m2/repository/com/squareup/retrofit2/retrofit-converters/2.4.0/retrofit-converters-2.4.0.pom
[warn]
[warn]  :: com.squareup.okhttp3#okhttp;3.11.0: Resolution failed several times for dependency: com.squareup.okhttp3#okhttp;3.11.0 {compile=[compile(*), master(*)], runtime=[runtime(*)]}::
[warn]  com.squareup.okhttp3#okhttp;3.11.0!okhttp.pom(pom.original) origin location must be absolute: file:/Users/anirudh.vyas/.m2/repository/com/squareup/okhttp3/okhttp/3.11.0/okhttp-3.11.0.pom
[warn]  com.squareup.okhttp3#okhttp;3.11.0!okhttp.pom(pom.original) origin location must be absolute: file:/Users/anirudh.vyas/.m2/repository/com/squareup/okhttp3/okhttp/3.11.0/okhttp-3.11.0.pom
[warn]  com.squareup.okhttp3#okhttp;3.11.0!okhttp.pom(pom.original) origin location must be absolute: file:/Users/anirudh.vyas/.m2/repository/com/squareup/okhttp3/okhttp/3.11.0/okhttp-3.11.0.pom
[warn]  com.squareup.okhttp3#okhttp;3.11.0!okhttp.pom(pom.original) origin location must be absolute: file:/Users/anirudh.vyas/.m2/repository/com/squareup/okhttp3/okhttp/3.11.0/okhttp-3.11.0.pom
[warn]  :: com.squareup.okhttp3#logging-interceptor;3.11.0: Resolution failed several times for dependency: com.squareup.okhttp3#logging-interceptor;3.11.0 {compile=[compile(*), master(*)], runtime=[runtime(*)]}::
[warn]  com.squareup.okhttp3#logging-interceptor;3.11.0!logging-interceptor.pom(pom.original) origin location must be absolute: file:/Users/anirudh.vyas/.m2/repository/com/squareup/okhttp3/logging-interceptor/3.11.0/logging-interceptor-3.11.0.pom
[warn]  com.squareup.okhttp3#logging-interceptor;3.11.0!logging-interceptor.pom(pom.original) origin location must be absolute: file:/Users/anirudh.vyas/.m2/repository/com/squareup/okhttp3/logging-interceptor/3.11.0/logging-interceptor-3.11.0.pom
[warn]  com.squareup.okhttp3#logging-interceptor;3.11.0!logging-interceptor.pom(pom.original) origin location must be absolute: file:/Users/anirudh.vyas/.m2/repository/com/squareup/okhttp3/logging-interceptor/3.11.0/logging-interceptor-3.11.0.pom
[warn]  com.squareup.okhttp3#logging-interceptor;3.11.0!logging-interceptor.pom(pom.original) origin location must be absolute: file:/Users/anirudh.vyas/.m2/repository/com/squareup/okhttp3/logging-interceptor/3.11.0/logging-interceptor-3.11.0.pom
[warn]  ::::::::::::::::::::::::::::::::::::::::::::::
[warn]
[warn]  Note: Unresolved dependencies path:
[warn]      com.squareup.retrofit2:retrofit:2.4.0
[warn]        +- org.influxdb:influxdb-java:2.14
[warn]        +- ch.cern.sparkmeasure:spark-measure_2.12:0.22 (Defaults.scala#L4318)
[warn]        +- com.workday.perftool:spark-commons_2.12:0.0.34-SNAPSHOT
[warn]      com.squareup.retrofit2:converter-moshi:2.4.0
[warn]        +- org.influxdb:influxdb-java:2.14
[warn]        +- ch.cern.sparkmeasure:spark-measure_2.12:0.22 (Defaults.scala#L4318)
[warn]        +- com.workday.perftool:spark-commons_2.12:0.0.34-SNAPSHOT
[warn]      com.squareup.okhttp3:okhttp:3.11.0
[warn]        +- org.influxdb:influxdb-java:2.14
[warn]        +- ch.cern.sparkmeasure:spark-measure_2.12:0.22 (Defaults.scala#L4318)
[warn]        +- com.workday.perftool:spark-commons_2.12:0.0.34-SNAPSHOT
[warn]      com.squareup.okhttp3:logging-interceptor:3.11.0
[warn]        +- org.influxdb:influxdb-java:2.14
[warn]        +- ch.cern.sparkmeasure:spark-measure_2.12:0.22 (Defaults.scala#L4318)
[warn]        +- com.workday.perftool:spark-commons_2.12:0.0.34-SNAPSHOT

What should I do differently?

AnirudhVyas commented 1 year ago

To solve (wont exactly call it solved) I import build dependency marking it with

"ch.cern.sparkmeasure" % "spark-measure_2.12" % sparkMeasureVersion_212 intransitive()