d2iq-archive / marathon

Deploy and manage containers (including Docker) on top of Apache Mesos at scale.
https://mesosphere.github.io/marathon/
Apache License 2.0
4.07k stars 843 forks source link

master branch build generates warnings and dependency issues, also api endpoints are not working. #7203

Closed f1-outsourcing closed 4 years ago

f1-outsourcing commented 4 years ago

Can build from master, but lots of warnings, I am getting these library dependency issues.

https://repo1.maven.org/maven2/com/google/guava/guava/29.0-jre/guava-29.0-jre.jar
  100.0% [##########] 2.7 MiB (146.3 KiB / s)
[info] Fetched artifacts of
[warn] There may be incompatibilities among your library dependencies; run 'evicted' to see detailed eviction warnings.
[info] Compiling 634 Scala sources and 9 Java sources to /home/software/marathon3/target/scala-2.13/classes ...
https://repo1.maven.org/maven2/org/scala-sbt/compiler-bridge_2.13/1.3.4/compiler-bridge_2.13-1.3.4.pom
  100.0% [##########] 2.8 KiB (117.3 KiB / s)
https://repo1.maven.org/maven2/org/scala-sbt/util-interface/1.3.0/util-interface-1.3.0.jar
  100.0% [##########] 2.5 KiB (20.4 KiB / s)
[info] Non-compiled module 'compiler-bridge_2.13' for Scala 2.13.1. Compiling...
[@test2 marathon3]$ sbt -mem 2048 evicted
[info] Loading project definition from /home/software/marathon3/project/project
[info] Loading settings for project marathon3-build from plugins.sbt ...
[info] Loading project definition from /home/software/marathon3/type-generator/project
[info] Loading settings for project root from build.sbt ...
[info] Loading project definition from /home/software/marathon3/project
[info] Loading settings for project marathon from build.sbt ...
[info] Set current project to marathon (in build file:/home/software/marathon3/)
[warn] Found version conflict(s) in library dependencies; some are suspected to be binary incompatible:
[warn]  * com.google.guava:guava:29.0-jre is selected over {19.0, 20.0, 20.0, 19.0, 20.0, 20.0}
[warn]      +- mesosphere.marathon:marathon_2.13:1.10.25          (depends on 29.0-jre)
[warn]      +- org.apache.curator:curator-client:4.0.1            (depends on 20.0)
[warn]      +- mesosphere.marathon:plugin-interface_2.13:1.10.25  (depends on 20.0)
[warn]      +- com.google.inject:guice:4.1.0                      (depends on 19.0)
[warn]  * com.typesafe.akka:akka-stream_2.13:2.6.5 is selected over {2.5.23, 2.5.23, 2.6.3, 2.5.23, 2.5.23, 2.6.3}
[warn]      +- mesosphere.marathon:marathon_2.13:1.10.25          (depends on 2.6.5)
[warn]      +- de.heikoseeberger:akka-http-play-json_2.13:1.31.0  (depends on 2.6.3)
[warn]      +- com.lightbend.akka:akka-stream-alpakka-simple-codecs_2.13:1.1.2 (depends on 2.5.23)
[warn]      +- com.lightbend.akka:akka-stream-alpakka-s3_2.13:1.1.2 (depends on 2.5.23)
[warn]  * junit:junit:4.12 is selected over 3.8.1
[warn]      +- jline:jline:0.9.94                                 (depends on 3.8.1)
[info] Here are other dependency conflicts that were resolved:
[info]  * joda-time:joda-time:2.10.5 is selected over {2.8.1, 2.9.1, 2.8.1, 2.9.1}
[info]      +- com.typesafe.play:play-json_2.13:2.8.1             (depends on 2.10.5)
[info]      +- com.papertrail:profiler:1.0.2                      (depends on 2.9.1)
[info]      +- com.amazonaws:aws-java-sdk-core:1.11.476           (depends on 2.8.1)
[info]  * com.typesafe.akka:akka-http_2.13:10.1.11 is selected over {10.1.10, 10.1.10}
[info]      +- mesosphere.marathon:marathon_2.13:1.10.25          (depends on 10.1.11)
[info]      +- com.lightbend.akka:akka-stream-alpakka-s3_2.13:1.1.2 (depends on 10.1.10)
[info]  * org.glassfish.jersey.core:jersey-server:2.27 is selected over 2.25.1
[info]      +- mesosphere.marathon:marathon_2.13:1.10.25          (depends on 2.27)
[info]      +- io.dropwizard.metrics:metrics-jersey2:4.0.2        (depends on 2.25.1)
[info]  * javax.annotation:javax.annotation-api:1.3.2 is selected over {1.2, 1.2, 1.2, 1.2}
[info]      +- mesosphere.marathon:marathon_2.13:1.10.25          (depends on 1.3.2)
[info]      +- org.glassfish.jersey.core:jersey-server:2.27       (depends on 1.2)
[info]      +- org.glassfish.jersey.core:jersey-common:2.27       (depends on 1.2)
[info]      +- org.glassfish.hk2:hk2-utils:2.5.0-b42              (depends on 1.2)
[info]      +- org.glassfish.hk2:hk2-locator:2.5.0-b42            (depends on 1.2)
[info]  * ch.qos.logback:logback-classic:1.2.3 is selected over {1.2.1, 1.2.1}
[info]      +- mesosphere.marathon:marathon_2.13:1.10.25          (depends on 1.2.3)
[info]      +- com.getsentry.raven:raven-logback:8.0.3            (depends on 1.2.1)
[info]  * com.typesafe.akka:akka-http-xml_2.13:10.1.11 is selected over {10.1.10, 10.1.10}
[info]      +- mesosphere.marathon:marathon_2.13:1.10.25          (depends on 10.1.11)
[info]      +- com.lightbend.akka:akka-stream-alpakka-s3_2.13:1.1.2 (depends on 10.1.10)
[info]  * com.fasterxml.jackson.core:jackson-annotations:2.10.2 is selected over {2.10.1, 2.10.1, 2.10.1, 2.10.1}
[info]      +- com.fasterxml.jackson.module:jackson-module-scala_2.13:2.10.2 (depends on 2.10.2)
[info]      +- com.fasterxml.jackson.module:jackson-module-jaxb-annotations:2.10.2 (depends on 2.10.2)
[info]      +- com.fasterxml.jackson.core:jackson-databind:2.10.2 (depends on 2.10.2)
[info]      +- com.typesafe.play:play-json_2.13:2.8.1             (depends on 2.10.1)
[info]      +- com.fasterxml.jackson.datatype:jackson-datatype-jsr310:2.10.1 (depends on 2.10.1)
[info]  * com.fasterxml.jackson.core:jackson-core:2.10.2 is selected over {2.6.7, 2.10.1, 2.10.1, 2.8.7, 2.10.1, 2.6.7, 2.10.1, 2.10.1, 2.8.7, 2.10.1}
[info]      +- com.fasterxml.jackson.module:jackson-module-scala_2.13:2.10.2 (depends on 2.10.2)
[info]      +- com.fasterxml.jackson.jaxrs:jackson-jaxrs-base:2.10.2 (depends on 2.10.2)
[info]      +- com.fasterxml.jackson.module:jackson-module-jaxb-annotations:2.10.2 (depends on 2.10.2)
[info]      +- com.fasterxml.jackson.module:jackson-module-afterburner:2.10.2 (depends on 2.10.2)
[info]      +- com.fasterxml.jackson.core:jackson-databind:2.10.2 (depends on 2.10.2)
[info]      +- com.typesafe.play:play-json_2.13:2.8.1             (depends on 2.10.1)
[info]      +- com.getsentry.raven:raven:8.0.3                    (depends on 2.8.7)
[info]      +- com.fasterxml.jackson.datatype:jackson-datatype-jsr310:2.10.1 (depends on 2.10.1)
[info]      +- com.fasterxml.jackson.datatype:jackson-datatype-jdk8:2.10.1 (depends on 2.10.1)
[info]      +- com.fasterxml.jackson.dataformat:jackson-dataformat-cbor:2.6.7 (depends on 2.6.7)
[info]  * com.fasterxml.jackson.core:jackson-databind:2.10.2 is selected over {2.6.7.2, 2.10.1, 2.10.1, 2.10.1, 2.9.3, 2.9.3, 2.6.5, 2.6.7.2, 2.10.1, 2.10.1, 2.10.1, 2.9.3, 2.9.3, 2.6.5, 2.6.7.2, 2.10.1, 2.10.1, 2.10.1, 2.9.3, 2.9.3, 2.6.5}
[info]      +- com.fasterxml.jackson.module:jackson-module-scala_2.13:2.10.2 (depends on 2.10.2)
[info]      +- com.fasterxml.jackson.module:jackson-module-paranamer:2.10.2 (depends on 2.10.2)
[info]      +- com.fasterxml.jackson.jaxrs:jackson-jaxrs-base:2.10.2 (depends on 2.10.2)
[info]      +- com.fasterxml.jackson.module:jackson-module-jaxb-annotations:2.10.2 (depends on 2.10.2)
[info]      +- com.fasterxml.jackson.module:jackson-module-afterburner:2.10.2 (depends on 2.10.2)
[info]      +- net.logstash.logback:logstash-logback-encoder:4.9  (depends on 2.6.5)
[info]      +- io.dropwizard.metrics:metrics-servlets:4.0.2       (depends on 2.9.3)
[info]      +- io.dropwizard.metrics:metrics-json:4.0.2           (depends on 2.9.3)
[info]      +- com.typesafe.play:play-json_2.13:2.8.1             (depends on 2.10.1)
[info]      +- com.fasterxml.jackson.datatype:jackson-datatype-jsr310:2.10.1 (depends on 2.10.1)
[info]      +- com.fasterxml.jackson.datatype:jackson-datatype-jdk8:2.10.1 (depends on 2.10.1)
[info]      +- com.amazonaws:aws-java-sdk-core:1.11.476           (depends on 2.6.7.2)
[info]  * ch.qos.logback:logback-core:1.2.3 is selected over {1.2.1, 1.2.1, 1.2.1, 1.2.1}
[info]      +- ch.qos.logback:logback-classic:1.2.3               (depends on 1.2.3)
[info]      +- net.logstash.logback:logstash-logback-encoder:4.9  (depends on 1.2.1)
[info]      +- com.getsentry.raven:raven-logback:8.0.3            (depends on 1.2.1)
[info]  * org.slf4j:slf4j-api:1.7.30 is selected over {1.7.25, 1.7.24, 1.7.24, 1.7.26, 1.7.25, 1.7.25, 1.7.25, 1.7.25, 1.7.25, 1.7.25, 1.7.25, 1.7.25, 1.7.6, 1.6.1, 1.7.21, 1.7.25, 1.7.24, 1.7.24, 1.7.26, 1.7.25, 1.7.25, 1.7.25, 1.7.25, 1.7.25, 1.7.25, 1.7.25, 1.7.25, 1.7.6, 1.6.1, 1.7.21, 1.7.25, 1.7.24, 1.7.24, 1.7.26, 1.7.25, 1.7.25, 1.7.25, 1.7.25, 1.7.25, 1.7.25, 1.7.25, 1.7.25, 1.7.6, 1.6.1, 1.7.21}
[info]      +- com.typesafe.akka:akka-slf4j_2.13:2.6.5            (depends on 1.7.30)
[info]      +- org.slf4j:jul-to-slf4j:1.7.21                      (depends on 1.7.21)
[info]      +- org.apache.zookeeper:zookeeper:3.4.11              (depends on 1.6.1)
[info]      +- org.apache.curator:curator-client:4.0.1            (depends on 1.7.6)
[info]      +- io.dropwizard.metrics:metrics-servlets:4.0.2       (depends on 1.7.25)
[info]      +- io.dropwizard.metrics:metrics-jvm:4.0.2            (depends on 1.7.25)
[info]      +- io.dropwizard.metrics:metrics-json:4.0.2           (depends on 1.7.25)
[info]      +- io.dropwizard.metrics:metrics-jetty9:4.0.2         (depends on 1.7.25)
[info]      +- io.dropwizard.metrics:metrics-jersey2:4.0.2        (depends on 1.7.25)
[info]      +- io.dropwizard.metrics:metrics-healthchecks:4.0.2   (depends on 1.7.25)
[info]      +- io.dropwizard.metrics:metrics-core:4.0.2           (depends on 1.7.25)
[info]      +- io.dropwizard.metrics:metrics-annotation:4.0.2     (depends on 1.7.25)
[info]      +- com.typesafe.scala-logging:scala-logging_2.13:3.9.2 (depends on 1.7.26)
[info]      +- com.getsentry.raven:raven-logback:8.0.3            (depends on 1.7.24)
[info]      +- com.getsentry.raven:raven:8.0.3                    (depends on 1.7.24)
[info]      +- ch.qos.logback:logback-classic:1.2.3               (depends on 1.7.25)
[info]  * org.scala-lang.modules:scala-java8-compat_2.13:0.9.1 is selected over {0.9.0, 0.9.0}
[info]      +- mesosphere.marathon:marathon_2.13:1.10.25          (depends on 0.9.1)
[info]      +- com.typesafe.akka:akka-actor_2.13:2.6.5            (depends on 0.9.0)
[success] Total time: 13 s, completed Jul 19, 2020 1:27:48 PM

Result again same as, end points not working https://github.com/mesosphere/marathon/issues/7200

timcharper commented 4 years ago

The warnings are benign. Marathon is built and tested regularly and rigorously. I am not sure why the endpoints are not working for you, I have to think there is perhaps some configuration issue on your side. I hate to give the "WOMM" response, and, it works on my machine, my colleagues machines, in the cloud, on our CI, and across a wide deployment of various clusters.

f1-outsourcing commented 4 years ago

Yes I can totally understand it. I think this must be something very trivial. Maybe it is related to initializing. I think I have been using 1.8 and got there upgrading from 1.7 versions. That is what I am going to try next. I was also thinking about things like that I am only testing with 1 mesos-master and zookeeper.

mesos-master config is totally stripped down.

/usr/sbin/mesos-master --zk=zk://m01.local:2181/mesos --port=5050 --log_dir=/var/log/mesos --logging_level=INFO --quorum=1 --work_dir=/var/lib/mesos

--agent_ping_timeout="15secs" --agent_reregister_timeout="10mins" --allocation_interval="1secs" --allocator="hierarchical" --authenticate_agents="false" --authenticate_frameworks="false" --authenticate_http_frameworks="false" --authenticate_http_readonly="false" --authenticate_http_readwrite="false" --authentication_v0_timeout="15secs" --authenticators="crammd5" --authorizers="local" --filter_gpu_resources="true" --framework_sorter="drf" --help="false" --hostname_lookup="true" --http_authenticators="basic" --initialize_driver_logging="true" --log_auto_initialize="true" --logbufsecs="0" --logging_level="INFO" --max_agent_ping_timeouts="5" --max_completed_frameworks="50" --max_completed_tasks_per_framework="1000" --max_operator_event_stream_subscribers="1000" --max_unreachable_tasks_per_framework="1000" --memory_profiling="false" --min_allocatable_resources="cpus:0.01|mem:32" --port="5050" --publish_per_framework_metrics="true" --quiet="false" --quorum="1" --recovery_agent_removal_limit="100%" --registry="replicated_log" --registry_fetch_timeout="1mins" --registry_gc_interval="15mins" --registry_max_agent_age="2weeks" --registry_max_agent_count="102400" --registry_store_timeout="20secs" --registry_strict="false" --require_agent_domain="false" --role_sorter="drf" --root_submissions="true" --version="false" --webui_dir="/usr/share/mesos/webui" --work_dir="/var/lib/mesos" --zk="zk://m01.local:2181/mesos" --zk_session_timeout="10secs"

f1-outsourcing commented 4 years ago

Pffffffffffffffffffffffffffffffffff, finally managed to get 1.8 running, by switching to java 11, 1.9 is also running now

update-alternatives --config java