Open grassit opened 4 years ago
I have followed the steps in https://github.com/MrPowers/spark-sbt.g8.
Why do some tests fail? Thanks.
$ sbt test [info] [launcher] getting org.scala-sbt sbt 1.2.6 (this may take some time)... downloading https://repo1.maven.org/maven2/org/scala-sbt/sbt/1.2.6/sbt-1.2.6.jar ... downloading https://repo1.maven.org/maven2/org/scala-lang/scala-library/2.12.7/scala-library-2.12.7.jar ... :: loading settings :: url = jar:file:/usr/share/sbt/bin/sbt-launch.jar!/org/apache/ivy/core/settings/ivysettings.xml :: loading settings :: url = jar:file:/usr/share/sbt/bin/sbt-launch.jar!/org/apache/ivy/core/settings/ivysettings.xml [SUCCESSFUL ] org.scala-sbt#sbt;1.2.6!sbt.jar (165ms) downloading https://repo1.maven.org/maven2/org/scala-sbt/main_2.12/1.2.6/main_2.12-1.2.6.jar ... [SUCCESSFUL ] org.scala-sbt#main_2.12;1.2.6!main_2.12.jar (2019ms) downloading https://repo1.maven.org/maven2/org/scala-sbt/logic_2.12/1.2.6/logic_2.12-1.2.6.jar ... [SUCCESSFUL ] org.scala-sbt#logic_2.12;1.2.6!logic_2.12.jar (63ms) downloading https://repo1.maven.org/maven2/org/scala-sbt/actions_2.12/1.2.6/actions_2.12-1.2.6.jar ... [SUCCESSFUL ] org.scala-lang#scala-library;2.12.7!scala-library.jar (2268ms) downloading https://repo1.maven.org/maven2/org/scala-sbt/main-settings_2.12/1.2.6/main-settings_2.12-1.2.6.jar ... [SUCCESSFUL ] org.scala-sbt#actions_2.12;1.2.6!actions_2.12.jar (110ms) downloading https://repo1.maven.org/maven2/org/scala-sbt/run_2.12/1.2.6/run_2.12-1.2.6.jar ... [SUCCESSFUL ] org.scala-sbt#run_2.12;1.2.6!run_2.12.jar (131ms) downloading https://repo1.maven.org/maven2/org/scala-sbt/command_2.12/1.2.6/command_2.12-1.2.6.jar ... [SUCCESSFUL ] org.scala-sbt#main-settings_2.12;1.2.6!main-settings_2.12.jar (317ms) downloading https://repo1.maven.org/maven2/org/scala-sbt/collections_2.12/1.2.6/collections_2.12-1.2.6.jar ... [SUCCESSFUL ] org.scala-sbt#command_2.12;1.2.6!command_2.12.jar (236ms) downloading https://repo1.maven.org/maven2/org/scala-sbt/scripted-sbt-redux_2.12/1.2.6/scripted-sbt-redux_2.12-1.2.6.jar ... [SUCCESSFUL ] org.scala-sbt#collections_2.12;1.2.6!collections_2.12.jar (150ms) downloading https://repo1.maven.org/maven2/org/scala-sbt/scripted-plugin_2.12/1.2.6/scripted-plugin_2.12-1.2.6.jar ... [SUCCESSFUL ] org.scala-sbt#scripted-plugin_2.12;1.2.6!scripted-plugin_2.12.jar (58ms) downloading https://repo1.maven.org/maven2/org/scala-sbt/launcher-interface/1.0.4/launcher-interface-1.0.4.jar ... [SUCCESSFUL ] org.scala-sbt#scripted-sbt-redux_2.12;1.2.6!scripted-sbt-redux_2.12.jar (73ms) downloading https://repo1.maven.org/maven2/org/apache/logging/log4j/log4j-api/2.8.1/log4j-api-2.8.1.jar ... [SUCCESSFUL ] org.scala-sbt#launcher-interface;1.0.4!launcher-interface.jar (100ms) downloading https://repo1.maven.org/maven2/org/apache/logging/log4j/log4j-core/2.8.1/log4j-core-2.8.1.jar ... [SUCCESSFUL ] org.apache.logging.log4j#log4j-api;2.8.1!log4j-api.jar (95ms) downloading https://repo1.maven.org/maven2/org/apache/logging/log4j/log4j-slf4j-impl/2.8.1/log4j-slf4j-impl-2.8.1.jar ... [SUCCESSFUL ] org.apache.logging.log4j#log4j-slf4j-impl;2.8.1!log4j-slf4j-impl.jar (278ms) downloading https://repo1.maven.org/maven2/org/scala-sbt/io_2.12/1.2.2/io_2.12-1.2.2.jar ... [SUCCESSFUL ] org.apache.logging.log4j#log4j-core;2.8.1!log4j-core.jar (383ms) downloading https://repo1.maven.org/maven2/org/scala-sbt/util-logging_2.12/1.2.3/util-logging_2.12-1.2.3.jar ... [SUCCESSFUL ] org.scala-sbt#io_2.12;1.2.2!io_2.12.jar (205ms) downloading https://repo1.maven.org/maven2/org/scala-sbt/librarymanagement-core_2.12/1.2.2/librarymanagement-core_2.12-1.2.2.jar ... [SUCCESSFUL ] org.scala-sbt#util-logging_2.12;1.2.3!util-logging_2.12.jar (113ms) downloading https://repo1.maven.org/maven2/org/scala-sbt/librarymanagement-ivy_2.12/1.2.2/librarymanagement-ivy_2.12-1.2.2.jar ... [SUCCESSFUL ] org.scala-sbt#librarymanagement-ivy_2.12;1.2.2!librarymanagement-ivy_2.12.jar (337ms) downloading https://repo1.maven.org/maven2/org/scala-sbt/compiler-interface/1.2.4/compiler-interface-1.2.4.jar ... [SUCCESSFUL ] org.scala-sbt#librarymanagement-core_2.12;1.2.2!librarymanagement-core_2.12.jar (364ms) downloading https://repo1.maven.org/maven2/org/scala-sbt/zinc-compile_2.12/1.2.4/zinc-compile_2.12-1.2.4.jar ... [SUCCESSFUL ] org.scala-sbt#compiler-interface;1.2.4!compiler-interface.jar (74ms) downloading https://repo1.maven.org/maven2/org/scala-sbt/util-relation_2.12/1.2.3/util-relation_2.12-1.2.3.jar ... [SUCCESSFUL ] org.scala-sbt#zinc-compile_2.12;1.2.4!zinc-compile_2.12.jar (67ms) downloading https://repo1.maven.org/maven2/org/scala-sbt/util-position_2.12/1.2.3/util-position_2.12-1.2.3.jar ... [SUCCESSFUL ] org.scala-sbt#util-relation_2.12;1.2.3!util-relation_2.12.jar (51ms) downloading https://repo1.maven.org/maven2/com/eed3si9n/sjson-new-core_2.12/0.8.2/sjson-new-core_2.12-0.8.2.jar ... [SUCCESSFUL ] org.scala-sbt#util-position_2.12;1.2.3!util-position_2.12.jar (154ms) downloading https://repo1.maven.org/maven2/org/scala-lang/scala-reflect/2.12.7/scala-reflect-2.12.7.jar ... [SUCCESSFUL ] com.eed3si9n#sjson-new-core_2.12;0.8.2!sjson-new-core_2.12.jar (303ms) downloading https://repo1.maven.org/maven2/org/scala-sbt/completion_2.12/1.2.6/completion_2.12-1.2.6.jar ... [SUCCESSFUL ] org.scala-sbt#completion_2.12;1.2.6!completion_2.12.jar (253ms) downloading https://repo1.maven.org/maven2/org/scala-sbt/task-system_2.12/1.2.6/task-system_2.12-1.2.6.jar ... [SUCCESSFUL ] org.scala-sbt#task-system_2.12;1.2.6!task-system_2.12.jar (211ms) downloading https://repo1.maven.org/maven2/org/scala-sbt/tasks_2.12/1.2.6/tasks_2.12-1.2.6.jar ... [SUCCESSFUL ] org.scala-sbt#tasks_2.12;1.2.6!tasks_2.12.jar (216ms) downloading https://repo1.maven.org/maven2/org/scala-sbt/testing_2.12/1.2.6/testing_2.12-1.2.6.jar ... [SUCCESSFUL ] org.scala-sbt#testing_2.12;1.2.6!testing_2.12.jar (91ms) downloading https://repo1.maven.org/maven2/org/scala-sbt/util-tracking_2.12/1.2.3/util-tracking_2.12-1.2.3.jar ... [SUCCESSFUL ] org.scala-lang#scala-reflect;2.12.7!scala-reflect.jar (1002ms) downloading https://repo1.maven.org/maven2/org/scala-sbt/zinc-classpath_2.12/1.2.4/zinc-classpath_2.12-1.2.4.jar ... [SUCCESSFUL ] org.scala-sbt#util-tracking_2.12;1.2.3!util-tracking_2.12.jar (76ms) downloading https://repo1.maven.org/maven2/org/scala-sbt/zinc-apiinfo_2.12/1.2.4/zinc-apiinfo_2.12-1.2.4.jar ... [SUCCESSFUL ] org.scala-sbt#zinc-classpath_2.12;1.2.4!zinc-classpath_2.12.jar (90ms) downloading https://repo1.maven.org/maven2/org/scala-sbt/zinc-ivy-integration_2.12/1.2.4/zinc-ivy-integration_2.12-1.2.4.jar ... [SUCCESSFUL ] org.scala-sbt#zinc-apiinfo_2.12;1.2.4!zinc-apiinfo_2.12.jar (68ms) downloading https://repo1.maven.org/maven2/org/scala-sbt/zinc_2.12/1.2.4/zinc_2.12-1.2.4.jar ... [SUCCESSFUL ] org.scala-sbt#zinc-ivy-integration_2.12;1.2.4!zinc-ivy-integration_2.12.jar (58ms) downloading https://repo1.maven.org/maven2/org/scala-sbt/util-control_2.12/1.2.3/util-control_2.12-1.2.3.jar ... [SUCCESSFUL ] org.scala-sbt#zinc_2.12;1.2.4!zinc_2.12.jar (77ms) downloading https://repo1.maven.org/maven2/com/swoval/apple-file-events/1.3.2/apple-file-events-1.3.2.jar ... [SUCCESSFUL ] org.scala-sbt#util-control_2.12;1.2.3!util-control_2.12.jar (64ms) downloading https://repo1.maven.org/maven2/org/scala-sbt/util-interface/1.2.3/util-interface-1.2.3.jar ... [SUCCESSFUL ] com.swoval#apple-file-events;1.3.2!apple-file-events.jar (49ms) downloading https://repo1.maven.org/maven2/com/lmax/disruptor/3.3.6/disruptor-3.3.6.jar ... [SUCCESSFUL ] org.scala-sbt#util-interface;1.2.3!util-interface.jar (61ms) downloading https://repo1.maven.org/maven2/org/scala-sbt/util-cache_2.12/1.2.3/util-cache_2.12-1.2.3.jar ... [SUCCESSFUL ] com.lmax#disruptor;3.3.6!disruptor.jar (87ms) downloading https://repo1.maven.org/maven2/com/eed3si9n/sjson-new-murmurhash_2.12/0.8.2/sjson-new-murmurhash_2.12-0.8.2.jar ... [SUCCESSFUL ] com.eed3si9n#sjson-new-murmurhash_2.12;0.8.2!sjson-new-murmurhash_2.12.jar (47ms) downloading https://repo1.maven.org/maven2/org/scala-sbt/test-agent/1.2.6/test-agent-1.2.6.jar ... [SUCCESSFUL ] org.scala-sbt#util-cache_2.12;1.2.3!util-cache_2.12.jar (90ms) downloading https://repo1.maven.org/maven2/org/scala-sbt/compiler-bridge_2.12/1.2.4/compiler-bridge_2.12-1.2.4.jar ... [SUCCESSFUL ] org.scala-sbt#test-agent;1.2.6!test-agent.jar (78ms) downloading https://repo1.maven.org/maven2/org/scala-sbt/zinc-classfile_2.12/1.2.4/zinc-classfile_2.12-1.2.4.jar ... [SUCCESSFUL ] org.scala-sbt#compiler-bridge_2.12;1.2.4!compiler-bridge_2.12.jar (108ms) downloading https://repo1.maven.org/maven2/org/scala-lang/scala-compiler/2.12.7/scala-compiler-2.12.7.jar ... [SUCCESSFUL ] org.scala-sbt#zinc-classfile_2.12;1.2.4!zinc-classfile_2.12.jar (67ms) downloading https://repo1.maven.org/maven2/com/eed3si9n/gigahorse-okhttp_2.12/0.3.0/gigahorse-okhttp_2.12-0.3.0.jar ... [SUCCESSFUL ] com.eed3si9n#gigahorse-okhttp_2.12;0.3.0!gigahorse-okhttp_2.12.jar (285ms) downloading https://repo1.maven.org/maven2/com/eed3si9n/gigahorse-core_2.12/0.3.0/gigahorse-core_2.12-0.3.0.jar ... [SUCCESSFUL ] com.eed3si9n#gigahorse-core_2.12;0.3.0!gigahorse-core_2.12.jar (303ms) downloading https://repo1.maven.org/maven2/com/squareup/okhttp3/okhttp/3.7.0/okhttp-3.7.0.jar ... [SUCCESSFUL ] com.squareup.okhttp3#okhttp;3.7.0!okhttp.jar (553ms) downloading https://repo1.maven.org/maven2/com/typesafe/ssl-config-core_2.12/0.2.2/ssl-config-core_2.12-0.2.2.jar ... [SUCCESSFUL ] com.typesafe#ssl-config-core_2.12;0.2.2!ssl-config-core_2.12.jar(bundle) (469ms) downloading https://repo1.maven.org/maven2/org/reactivestreams/reactive-streams/1.0.0/reactive-streams-1.0.0.jar ... [SUCCESSFUL ] org.reactivestreams#reactive-streams;1.0.0!reactive-streams.jar (483ms) downloading https://repo1.maven.org/maven2/com/squareup/okio/okio/1.12.0/okio-1.12.0.jar ... [SUCCESSFUL ] com.squareup.okio#okio;1.12.0!okio.jar (167ms) downloading https://repo1.maven.org/maven2/org/scala-sbt/zinc-compile-core_2.12/1.2.4/zinc-compile-core_2.12-1.2.4.jar ... [SUCCESSFUL ] org.scala-sbt#zinc-compile-core_2.12;1.2.4!zinc-compile-core_2.12.jar (89ms) downloading https://repo1.maven.org/maven2/org/scala-lang/modules/scala-parser-combinators_2.12/1.0.5/scala-parser-combinators_2.12-1.0.5.jar ... [SUCCESSFUL ] org.scala-lang#scala-compiler;2.12.7!scala-compiler.jar (2451ms) downloading https://repo1.maven.org/maven2/org/scala-sbt/zinc-core_2.12/1.2.4/zinc-core_2.12-1.2.4.jar ... [SUCCESSFUL ] org.scala-lang.modules#scala-parser-combinators_2.12;1.0.5!scala-parser-combinators_2.12.jar(bundle) (147ms) downloading https://repo1.maven.org/maven2/org/scala-sbt/zinc-persist_2.12/1.2.4/zinc-persist_2.12-1.2.4.jar ... [SUCCESSFUL ] org.scala-sbt#zinc-core_2.12;1.2.4!zinc-core_2.12.jar (135ms) downloading https://repo1.maven.org/maven2/com/google/protobuf/protobuf-java/3.3.1/protobuf-java-3.3.1.jar ... [SUCCESSFUL ] com.google.protobuf#protobuf-java;3.3.1!protobuf-java.jar(bundle) (695ms) downloading https://repo1.maven.org/maven2/org/scala-sbt/core-macros_2.12/1.2.6/core-macros_2.12-1.2.6.jar ... [SUCCESSFUL ] org.scala-sbt#core-macros_2.12;1.2.6!core-macros_2.12.jar (65ms) downloading https://repo1.maven.org/maven2/org/scala-sbt/protocol_2.12/1.2.6/protocol_2.12-1.2.6.jar ... [SUCCESSFUL ] org.scala-sbt#zinc-persist_2.12;1.2.4!zinc-persist_2.12.jar (819ms) downloading https://repo1.maven.org/maven2/org/scala-sbt/util-scripted_2.12/1.2.3/util-scripted_2.12-1.2.3.jar ... [SUCCESSFUL ] org.scala-sbt#util-scripted_2.12;1.2.3!util-scripted_2.12.jar (136ms) downloading https://repo1.maven.org/maven2/org/scala-sbt/ivy/ivy/2.3.0-sbt-b18f59ea3bc914a297bb6f1a4f7fb0ace399e310/ivy-2.3.0-sbt-b18f59ea3bc914a297bb6f1a4f7fb0ace399e310.jar ... [SUCCESSFUL ] org.scala-sbt#protocol_2.12;1.2.6!protocol_2.12.jar (411ms) [SUCCESSFUL ] org.scala-sbt.ivy#ivy;2.3.0-sbt-b18f59ea3bc914a297bb6f1a4f7fb0ace399e310!ivy.jar (306ms) :: retrieving :: org.scala-sbt#boot-app confs: [default] 80 artifacts copied, 0 already retrieved [info] [launcher] getting Scala 2.12.7 (for sbt)... :: retrieving :: org.scala-sbt#boot-scala confs: [default] 5 artifacts copied, 0 already retrieved [info] Loading settings for project my-cool-project-build from plugins.sbt ... [info] Loading project definition from /home/t/Spark/example/templateproject/MrPowers/my-cool-project/project [info] Loading settings for project my-cool-project from build.sbt ... [info] Set current project to my-cool-project (in build file:/home/t/Spark/example/templateproject/MrPowers/my-cool-project/) [info] Updating ... [info] downloading https://repo1.maven.org/maven2/org/scala-lang/scala-library/2.11.12/scala-library-2.11.12.jar ... [info] downloading http://dl.bintray.com/spark-packages/maven/mrpowers/spark-daria/0.35.2-s_2.11/spark-daria-0.35.2-s_2.11.jar ... [info] downloading http://dl.bintray.com/spark-packages/maven/MrPowers/spark-fast-tests/0.20.0-s_2.11/spark-fast-tests-0.20.0-s_2.11.jar ... [info] downloading https://repo1.maven.org/maven2/org/scala-lang/scala-reflect/2.11.12/scala-reflect-2.11.12.jar ... [info] downloading https://repo1.maven.org/maven2/org/apache/spark/spark-sql_2.11/2.4.4/spark-sql_2.11-2.4.4.jar ... [info] downloading https://repo1.maven.org/maven2/com/univocity/univocity-parsers/2.7.3/univocity-parsers-2.7.3.jar ... [info] downloading https://repo1.maven.org/maven2/org/apache/spark/spark-sketch_2.11/2.4.4/spark-sketch_2.11-2.4.4.jar ... [info] downloading https://repo1.maven.org/maven2/org/apache/spark/spark-core_2.11/2.4.4/spark-core_2.11-2.4.4.jar ... [info] downloading https://repo1.maven.org/maven2/org/apache/spark/spark-catalyst_2.11/2.4.4/spark-catalyst_2.11-2.4.4.jar ... [info] downloading https://repo1.maven.org/maven2/org/apache/spark/spark-tags_2.11/2.4.4/spark-tags_2.11-2.4.4.jar ... [info] downloading https://repo1.maven.org/maven2/org/apache/parquet/parquet-column/1.10.1/parquet-column-1.10.1.jar ... [info] downloading https://repo1.maven.org/maven2/org/apache/parquet/parquet-hadoop/1.10.1/parquet-hadoop-1.10.1.jar ... [info] downloading https://repo1.maven.org/maven2/org/apache/arrow/arrow-vector/0.10.0/arrow-vector-0.10.0.jar ... [info] downloading https://repo1.maven.org/maven2/org/apache/xbean/xbean-asm6-shaded/4.8/xbean-asm6-shaded-4.8.jar ... [info] downloading https://repo1.maven.org/maven2/org/apache/avro/avro/1.8.2/avro-1.8.2.jar ... [info] downloading https://repo1.maven.org/maven2/com/twitter/chill-java/0.9.3/chill-java-0.9.3.jar ... [info] downloading https://repo1.maven.org/maven2/com/twitter/chill_2.11/0.9.3/chill_2.11-0.9.3.jar ... [info] downloading https://repo1.maven.org/maven2/org/apache/spark/spark-launcher_2.11/2.4.4/spark-launcher_2.11-2.4.4.jar ... [info] downloading https://repo1.maven.org/maven2/org/apache/spark/spark-network-common_2.11/2.4.4/spark-network-common_2.11-2.4.4.jar ... [info] downloading https://repo1.maven.org/maven2/org/apache/spark/spark-kvstore_2.11/2.4.4/spark-kvstore_2.11-2.4.4.jar ... [info] downloading https://repo1.maven.org/maven2/org/apache/spark/spark-network-shuffle_2.11/2.4.4/spark-network-shuffle_2.11-2.4.4.jar ... [info] downloading https://repo1.maven.org/maven2/org/apache/spark/spark-unsafe_2.11/2.4.4/spark-unsafe_2.11-2.4.4.jar ... [info] downloading https://repo1.maven.org/maven2/org/apache/orc/orc-core/1.5.5/orc-core-1.5.5-nohive.jar ... [info] downloading https://repo1.maven.org/maven2/org/apache/orc/orc-mapreduce/1.5.5/orc-mapreduce-1.5.5-nohive.jar ... [info] downloading https://repo1.maven.org/maven2/org/apache/avro/avro-mapred/1.8.2/avro-mapred-1.8.2-hadoop2.jar ... [info] downloading https://repo1.maven.org/maven2/org/xerial/snappy/snappy-java/1.1.7.3/snappy-java-1.1.7.3.jar ... [info] downloading https://repo1.maven.org/maven2/org/roaringbitmap/RoaringBitmap/0.7.45/RoaringBitmap-0.7.45.jar ... [info] downloading https://repo1.maven.org/maven2/org/json4s/json4s-jackson_2.11/3.5.3/json4s-jackson_2.11-3.5.3.jar ... [info] downloading https://repo1.maven.org/maven2/net/sf/py4j/py4j/0.10.7/py4j-0.10.7.jar ... [info] downloading https://repo1.maven.org/maven2/org/objenesis/objenesis/2.5.1/objenesis-2.5.1.jar ... [info] downloading https://repo1.maven.org/maven2/com/esotericsoftware/kryo-shaded/4.0.2/kryo-shaded-4.0.2.jar ... [info] downloading https://repo1.maven.org/maven2/org/apache/commons/commons-compress/1.8.1/commons-compress-1.8.1.jar ... [info] downloading https://repo1.maven.org/maven2/org/tukaani/xz/1.5/xz-1.5.jar ... [info] downloading https://repo1.maven.org/maven2/org/apache/avro/avro-ipc/1.8.2/avro-ipc-1.8.2.jar ... [info] downloading https://repo1.maven.org/maven2/junit/junit/3.8.1/junit-3.8.1.jar ... [info] downloading https://repo1.maven.org/maven2/org/json4s/json4s-ast_2.11/3.5.3/json4s-ast_2.11-3.5.3.jar ... [info] downloading https://repo1.maven.org/maven2/org/json4s/json4s-scalap_2.11/3.5.3/json4s-scalap_2.11-3.5.3.jar ... [info] downloading https://repo1.maven.org/maven2/org/scala-lang/modules/scala-xml_2.11/1.0.6/scala-xml_2.11-1.0.6.jar ... [info] downloading https://repo1.maven.org/maven2/org/json4s/json4s-core_2.11/3.5.3/json4s-core_2.11-3.5.3.jar ... [info] downloading https://repo1.maven.org/maven2/org/roaringbitmap/shims/0.7.45/shims-0.7.45.jar ... [info] downloading https://repo1.maven.org/maven2/org/codehaus/janino/janino/3.0.9/janino-3.0.9.jar ... [info] downloading https://repo1.maven.org/maven2/org/codehaus/janino/commons-compiler/3.0.9/commons-compiler-3.0.9.jar ... [info] downloading https://repo1.maven.org/maven2/org/scala-lang/modules/scala-parser-combinators_2.11/1.1.0/scala-parser-combinators_2.11-1.1.0.jar ... [info] downloading https://repo1.maven.org/maven2/org/apache/parquet/parquet-encoding/1.10.1/parquet-encoding-1.10.1.jar ... [info] downloading https://repo1.maven.org/maven2/org/apache/parquet/parquet-common/1.10.1/parquet-common-1.10.1.jar ... [info] downloading https://repo1.maven.org/maven2/commons-codec/commons-codec/1.10/commons-codec-1.10.jar ... [info] downloading https://repo1.maven.org/maven2/io/airlift/aircompressor/0.10/aircompressor-0.10.jar ... [info] downloading https://repo1.maven.org/maven2/org/apache/orc/orc-shims/1.5.5/orc-shims-1.5.5.jar ... [info] downloading https://repo1.maven.org/maven2/org/apache/parquet/parquet-format/2.4.0/parquet-format-2.4.0.jar ... [info] downloading https://repo1.maven.org/maven2/org/apache/arrow/arrow-memory/0.10.0/arrow-memory-0.10.0.jar ... [info] downloading https://repo1.maven.org/maven2/org/apache/arrow/arrow-format/0.10.0/arrow-format-0.10.0.jar ... [info] downloading https://repo1.maven.org/maven2/org/apache/parquet/parquet-jackson/1.10.1/parquet-jackson-1.10.1.jar ... [info] downloading https://repo1.maven.org/maven2/jline/jline/2.14.3/jline-2.14.3.jar ... [info] downloading https://repo1.maven.org/maven2/org/scala-lang/scala-compiler/2.11.12/scala-compiler-2.11.12.jar ... [info] downloading https://repo1.maven.org/maven2/org/apache/httpcomponents/httpclient/4.2.5/httpclient-4.2.5.jar ... [info] downloading https://repo1.maven.org/maven2/org/apache/httpcomponents/httpcore/4.2.4/httpcore-4.2.4.jar ... [info] [SUCCESSFUL ] mrpowers#spark-daria;0.35.2-s_2.11!spark-daria.jar (1087ms) [info] [SUCCESSFUL ] org.apache.spark#spark-sketch_2.11;2.4.4!spark-sketch_2.11.jar (1144ms) [info] [SUCCESSFUL ] org.apache.spark#spark-tags_2.11;2.4.4!spark-tags_2.11.jar (1179ms) [info] [SUCCESSFUL ] MrPowers#spark-fast-tests;0.20.0-s_2.11!spark-fast-tests.jar (1336ms) [info] [SUCCESSFUL ] org.apache.spark#spark-kvstore_2.11;2.4.4!spark-kvstore_2.11.jar (1324ms) [info] [SUCCESSFUL ] com.twitter#chill-java;0.9.3!chill-java.jar (1446ms) [info] [SUCCESSFUL ] org.apache.spark#spark-launcher_2.11;2.4.4!spark-launcher_2.11.jar (1462ms) [info] [SUCCESSFUL ] org.roaringbitmap#shims;0.7.45!shims.jar (980ms) [info] [SUCCESSFUL ] org.apache.orc#orc-shims;1.5.5!orc-shims.jar (1083ms) [info] [SUCCESSFUL ] org.apache.spark#spark-unsafe_2.11;2.4.4!spark-unsafe_2.11.jar (1745ms) [info] [SUCCESSFUL ] org.apache.spark#spark-network-shuffle_2.11;2.4.4!spark-network-shuffle_2.11.jar (1784ms) [info] [SUCCESSFUL ] org.objenesis#objenesis;2.5.1!objenesis.jar (1459ms) [info] [SUCCESSFUL ] org.codehaus.janino#commons-compiler;3.0.9!commons-compiler.jar (1246ms) [info] [SUCCESSFUL ] org.json4s#json4s-jackson_2.11;3.5.3!json4s-jackson_2.11.jar (1548ms) [info] [SUCCESSFUL ] org.apache.arrow#arrow-format;0.10.0!arrow-format.jar (1429ms) [info] [SUCCESSFUL ] org.apache.arrow#arrow-memory;0.10.0!arrow-memory.jar (1587ms) [info] [SUCCESSFUL ] org.json4s#json4s-ast_2.11;3.5.3!json4s-ast_2.11.jar (1850ms) [info] [SUCCESSFUL ] org.apache.parquet#parquet-common;1.10.1!parquet-common.jar (1786ms) [info] [SUCCESSFUL ] org.tukaani#xz;1.5!xz.jar (2107ms) [info] [SUCCESSFUL ] org.apache.avro#avro-ipc;1.8.2!avro-ipc.jar(bundle) (2607ms) [info] [SUCCESSFUL ] junit#junit;3.8.1!junit.jar (2519ms) [info] [SUCCESSFUL ] net.sf.py4j#py4j;0.10.7!py4j.jar (2644ms) [info] [SUCCESSFUL ] io.airlift#aircompressor;0.10!aircompressor.jar (2409ms) [info] [SUCCESSFUL ] org.apache.avro#avro-mapred;1.8.2!avro-mapred.jar (3440ms) [info] [SUCCESSFUL ] com.twitter#chill_2.11;0.9.3!chill_2.11.jar (3439ms) [info] [SUCCESSFUL ] org.apache.httpcomponents#httpcore;4.2.4!httpcore.jar (3633ms) [info] [SUCCESSFUL ] org.apache.xbean#xbean-asm6-shaded;4.8!xbean-asm6-shaded.jar(bundle) (4045ms) [info] [SUCCESSFUL ] org.apache.parquet#parquet-hadoop;1.10.1!parquet-hadoop.jar (4059ms) [info] [SUCCESSFUL ] commons-codec#commons-codec;1.10!commons-codec.jar (3941ms) [info] [SUCCESSFUL ] org.apache.commons#commons-compress;1.8.1!commons-compress.jar (4174ms) [info] [SUCCESSFUL ] org.roaringbitmap#RoaringBitmap;0.7.45!RoaringBitmap.jar (4343ms) [info] [SUCCESSFUL ] jline#jline;2.14.3!jline.jar (3827ms) [info] [SUCCESSFUL ] com.univocity#univocity-parsers;2.7.3!univocity-parsers.jar (4605ms) [info] [SUCCESSFUL ] com.esotericsoftware#kryo-shaded;4.0.2!kryo-shaded.jar(bundle) (4752ms) [info] [SUCCESSFUL ] org.apache.httpcomponents#httpclient;4.2.5!httpclient.jar (4718ms) [info] [SUCCESSFUL ] org.scala-lang.modules#scala-parser-combinators_2.11;1.1.0!scala-parser-combinators_2.11.jar(bundle) (4548ms) [info] [SUCCESSFUL ] org.json4s#json4s-scalap_2.11;3.5.3!json4s-scalap_2.11.jar (5063ms) [info] [SUCCESSFUL ] org.scala-lang.modules#scala-xml_2.11;1.0.6!scala-xml_2.11.jar(bundle) (5064ms) [info] [SUCCESSFUL ] org.json4s#json4s-core_2.11;3.5.3!json4s-core_2.11.jar (5412ms) [info] [SUCCESSFUL ] org.apache.parquet#parquet-format;2.4.0!parquet-format.jar (5382ms) [info] [SUCCESSFUL ] org.apache.orc#orc-mapreduce;1.5.5!orc-mapreduce.jar (6498ms) [info] [SUCCESSFUL ] org.apache.parquet#parquet-encoding;1.10.1!parquet-encoding.jar (5905ms) [info] [SUCCESSFUL ] org.codehaus.janino#janino;3.0.9!janino.jar (5929ms) [info] [SUCCESSFUL ] org.apache.parquet#parquet-jackson;1.10.1!parquet-jackson.jar (6227ms) [info] [SUCCESSFUL ] org.apache.parquet#parquet-column;1.10.1!parquet-column.jar (6931ms) [info] [SUCCESSFUL ] org.apache.arrow#arrow-vector;0.10.0!arrow-vector.jar (7414ms) [info] [SUCCESSFUL ] org.apache.avro#avro;1.8.2!avro.jar(bundle) (7985ms) [info] [SUCCESSFUL ] org.apache.orc#orc-core;1.5.5!orc-core.jar (8187ms) [info] [SUCCESSFUL ] org.xerial.snappy#snappy-java;1.1.7.3!snappy-java.jar(bundle) (8731ms) [info] [SUCCESSFUL ] org.apache.spark#spark-network-common_2.11;2.4.4!spark-network-common_2.11.jar (9424ms) [info] [SUCCESSFUL ] org.scala-lang#scala-reflect;2.11.12!scala-reflect.jar (12432ms) [info] [SUCCESSFUL ] org.scala-lang#scala-library;2.11.12!scala-library.jar (13819ms) [info] [SUCCESSFUL ] org.apache.spark#spark-catalyst_2.11;2.4.4!spark-catalyst_2.11.jar (18677ms) [info] [SUCCESSFUL ] org.apache.spark#spark-sql_2.11;2.4.4!spark-sql_2.11.jar (18688ms) [info] [SUCCESSFUL ] org.apache.spark#spark-core_2.11;2.4.4!spark-core_2.11.jar (19783ms) [info] [SUCCESSFUL ] org.scala-lang#scala-compiler;2.11.12!scala-compiler.jar (19150ms) [info] Done updating. [info] Compiling 2 Scala sources to /home/t/Spark/example/templateproject/MrPowers/my-cool-project/target/scala-2.11/classes ... [info] Non-compiled module 'compiler-bridge_2.11' for Scala 2.11.12. Compiling... [info] Compilation completed in 43.301s. [info] Done compiling. WARNING: An illegal reflective access operation has occurred WARNING: Illegal reflective access by com.google.protobuf.UnsafeUtil (file:/home/t/.sbt/boot/scala-2.12.7/org.scala-sbt/sbt/1.2.6/protobuf-java-3.3.1.jar) to field java.nio.Buffer.address WARNING: Please consider reporting this to the maintainers of com.google.protobuf.UnsafeUtil WARNING: Use --illegal-access=warn to enable warnings of further illegal reflective access operations WARNING: All illegal access operations will be denied in a future release [info] Compiling 2 Scala sources to /home/t/Spark/example/templateproject/MrPowers/my-cool-project/target/scala-2.11/test-classes ... [info] Done compiling. OpenJDK 64-Bit Server VM warning: Ignoring option MaxPermSize; support was removed in 8.0 [info] MannersSpec: [info] .happyData Using Spark's default log4j profile: org/apache/spark/log4j-defaults.properties 20/03/18 14:16:54 WARN Utils: Your hostname, ocean resolves to a loopback address: 127.0.1.1; using 192.168.122.1 instead (on interface virbr0) 20/03/18 14:16:54 WARN Utils: Set SPARK_LOCAL_IP if you need to bind to another address WARNING: An illegal reflective access operation has occurred WARNING: Illegal reflective access by org.apache.spark.unsafe.Platform (file:/home/t/.ivy2/cache/org.apache.spark/spark-unsafe_2.11/jars/spark-unsafe_2.11-2.4.4.jar) to method java.nio.Bits.unaligned() WARNING: Please consider reporting this to the maintainers of org.apache.spark.unsafe.Platform WARNING: Use --illegal-access=warn to enable warnings of further illegal reflective access operations WARNING: All illegal access operations will be denied in a future release 20/03/18 14:16:55 INFO SparkContext: Running Spark version 2.4.4 20/03/18 14:16:56 WARN NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 20/03/18 14:16:57 INFO SparkContext: Submitted application: spark session 20/03/18 14:16:57 INFO SecurityManager: Changing view acls to: t 20/03/18 14:16:57 INFO SecurityManager: Changing modify acls to: t 20/03/18 14:16:57 INFO SecurityManager: Changing view acls groups to: 20/03/18 14:16:57 INFO SecurityManager: Changing modify acls groups to: 20/03/18 14:16:57 INFO SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users with view permissions: Set(t); groups with view permissions: Set(); users with modify permissions: Set(t); groups with modify permissions: Set() 20/03/18 14:16:59 INFO Utils: Successfully started service 'sparkDriver' on port 41783. 20/03/18 14:16:59 INFO SparkEnv: Registering MapOutputTracker 20/03/18 14:16:59 INFO SparkEnv: Registering BlockManagerMaster 20/03/18 14:16:59 INFO BlockManagerMasterEndpoint: Using org.apache.spark.storage.DefaultTopologyMapper for getting topology information 20/03/18 14:16:59 INFO BlockManagerMasterEndpoint: BlockManagerMasterEndpoint up 20/03/18 14:16:59 INFO DiskBlockManager: Created local directory at /tmp/blockmgr-4dcabd07-2774-4eb1-96bc-59752fedaa69 20/03/18 14:16:59 INFO MemoryStore: MemoryStore started with capacity 1048.8 MB 20/03/18 14:16:59 INFO SparkEnv: Registering OutputCommitCoordinator 20/03/18 14:17:00 INFO Utils: Successfully started service 'SparkUI' on port 4040. 20/03/18 14:17:00 INFO SparkUI: Bound SparkUI to 0.0.0.0, and started at http://192.168.122.1:4040 20/03/18 14:17:00 INFO Executor: Starting executor ID driver on host localhost 20/03/18 14:17:01 INFO Utils: Successfully started service 'org.apache.spark.network.netty.NettyBlockTransferService' on port 46591. 20/03/18 14:17:01 INFO NettyBlockTransferService: Server created on 192.168.122.1:46591 20/03/18 14:17:01 INFO BlockManager: Using org.apache.spark.storage.RandomBlockReplicationPolicy for block replication policy 20/03/18 14:17:01 INFO BlockManagerMaster: Registering BlockManager BlockManagerId(driver, 192.168.122.1, 46591, None) 20/03/18 14:17:01 INFO BlockManagerMasterEndpoint: Registering block manager 192.168.122.1:46591 with 1048.8 MB RAM, BlockManagerId(driver, 192.168.122.1, 46591, None) 20/03/18 14:17:01 INFO BlockManagerMaster: Registered BlockManager BlockManagerId(driver, 192.168.122.1, 46591, None) 20/03/18 14:17:01 INFO BlockManager: Initialized BlockManager: BlockManagerId(driver, 192.168.122.1, 46591, None) 20/03/18 14:17:08 INFO SharedState: Setting hive.metastore.warehouse.dir ('null') to the value of spark.sql.warehouse.dir ('file:/home/t/Spark/example/templateproject/MrPowers/my-cool-project/spark-warehouse'). 20/03/18 14:17:08 INFO SharedState: Warehouse path is 'file:/home/t/Spark/example/templateproject/MrPowers/my-cool-project/spark-warehouse'. 20/03/18 14:17:09 INFO StateStoreCoordinatorRef: Registered StateStoreCoordinator endpoint 20/03/18 14:17:10 INFO CodeGenerator: Code generated in 749.168653 ms 20/03/18 14:17:13 INFO CodeGenerator: Code generated in 74.60572 ms 20/03/18 14:17:13 INFO CodeGenerator: Code generated in 54.377386 ms [info] - appends a happy column to a DataFrame *** FAILED *** (20 seconds, 13 milliseconds) [info] java.lang.IllegalArgumentException: Unsupported class file major version 55 [info] at org.apache.xbean.asm6.ClassReader.<init>(ClassReader.java:166) [info] at org.apache.xbean.asm6.ClassReader.<init>(ClassReader.java:148) [info] at org.apache.xbean.asm6.ClassReader.<init>(ClassReader.java:136) [info] at org.apache.xbean.asm6.ClassReader.<init>(ClassReader.java:237) [info] at org.apache.spark.util.ClosureCleaner$.getClassReader(ClosureCleaner.scala:49) [info] at org.apache.spark.util.FieldAccessFinder$$anon$3$$anonfun$visitMethodInsn$2.apply(ClosureCleaner.scala:517) [info] at org.apache.spark.util.FieldAccessFinder$$anon$3$$anonfun$visitMethodInsn$2.apply(ClosureCleaner.scala:500) [info] at scala.collection.TraversableLike$WithFilter$$anonfun$foreach$1.apply(TraversableLike.scala:733) [info] at scala.collection.mutable.HashMap$$anon$1$$anonfun$foreach$2.apply(HashMap.scala:134) [info] at scala.collection.mutable.HashMap$$anon$1$$anonfun$foreach$2.apply(HashMap.scala:134) [info] ... 20/03/18 14:17:14 INFO SparkContext: Invoking stop() from shutdown hook 20/03/18 14:17:14 INFO SparkUI: Stopped Spark web UI at http://192.168.122.1:4040 20/03/18 14:17:14 INFO MapOutputTrackerMasterEndpoint: MapOutputTrackerMasterEndpoint stopped! 20/03/18 14:17:14 INFO MemoryStore: MemoryStore cleared 20/03/18 14:17:14 INFO BlockManager: BlockManager stopped 20/03/18 14:17:14 INFO BlockManagerMaster: BlockManagerMaster stopped 20/03/18 14:17:14 INFO OutputCommitCoordinator$OutputCommitCoordinatorEndpoint: OutputCommitCoordinator stopped! 20/03/18 14:17:14 INFO SparkContext: Successfully stopped SparkContext 20/03/18 14:17:14 INFO ShutdownHookManager: Shutdown hook called 20/03/18 14:17:14 INFO ShutdownHookManager: Deleting directory /tmp/spark-bfdd44bf-bc37-4e28-9ab3-cdfa90063c34 [info] Run completed in 24 seconds, 886 milliseconds. [info] Total number of tests run: 1 [info] Suites: completed 1, aborted 0 [info] Tests: succeeded 0, failed 1, canceled 0, ignored 0, pending 0 [info] *** 1 TEST FAILED *** [error] Failed tests: [error] com.github.mrpowers.my.cool.project.MannersSpec [error] (Test / test) sbt.TestsFailedException: Tests unsuccessful [error] Total time: 130 s, completed Mar 18, 2020, 2:17:16 PM
I Googled your error message & looks like this might help.
Thanks for raising this issue and let me know if that helps!
I have followed the steps in https://github.com/MrPowers/spark-sbt.g8.
Why do some tests fail? Thanks.