maziyarpanahi
commented
4 years ago Please format your codes and errors to be readable.
In addition, make sure if you are developing an app in IDE, you first test the library with any additional codes/third-party libraries/etc. We can’t debug your personal project inside IDE as it depends on so many other things than Spark NLP. The use of pretrained pipelines been tested in all the languages, so this must be an error in conflict with your current development environment. If you can make a vanilla test without anything else would help us help better.
Hi,
Description
While trying to use explain_document_ml by executing the method as below: PretrainedPipeline pipeline = new PretrainedPipeline("explain_document_ml","en"); pipeline.transform(dataset).show(false);
NB: dataset is a Dataset created from HBase table;
I get the following Java Exception Exception in thread "main" java.lang.NoSuchMethodError: com.typesafe.config.ConfigFactory.load()Lcom/typesafe/config/Config;
Expected Behavior
Current Behavior
cd /home/master/NetBeansProject/New; JAVA_HOME=/usr/lib/jvm/java-8-oracle /opt/netbeans/java/maven/bin/mvn "-Dexec.args=-classpath %classpath main.Launcher" -Dexec.executable=/usr/lib/jvm/java-8-oracle/bin/java org.codehaus.mojo:exec-maven-plugin:1.2.1:exec Running NetBeans Compile On Save execution. Phase execution is skipped and output directories of dependency projects (with Compile on Save turned on) will be used instead of their jar artifacts. Scanning for projects...
Building FirstApp 1.0-SNAPSHOT
The POM for org.glassfish:javax.el:jar:3.0.1-b06-SNAPSHOT is missing, no dependency information available The POM for org.glassfish:javax.el:jar:3.0.1-b07-SNAPSHOT is missing, no dependency information available The POM for org.glassfish:javax.el:jar:3.0.1-b08-SNAPSHOT is missing, no dependency information available The POM for org.glassfish:javax.el:jar:3.0.1-b11-SNAPSHOT is missing, no dependency information available
--- exec-maven-plugin:1.2.1:exec (default-cli) @ FirstApp --- Apr 19, 2020 5:51:32 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:32,974 WARN [main] util.Utils: Your hostname, masterX resolves to a loopback address: 127.0.0.1; using 192.168.1.6 instead (on interface wlan0) Apr 19, 2020 5:51:32 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:32,975 WARN [main] util.Utils: Set SPARK_LOCAL_IP if you need to bind to another address Apr 19, 2020 5:51:33 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:33,513 WARN [main] util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable Apr 19, 2020 5:51:33 PM org.apache.spark.launcher.OutputRedirector redirect INFO: <---- Graph Creation ----> Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,024 INFO [main] spark.SparkContext: Running Spark version 2.4.0 Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,041 WARN [main] spark.SparkConf: Note that spark.local.dir will be overridden by the value set by the cluster manager (via SPARK_LOCAL_DIRS in mesos/standalone/kubernetes and LOCAL_DIRS in YARN). Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,046 INFO [main] spark.SparkContext: Submitted application: Graph Creation Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,102 INFO [main] spark.SecurityManager: Changing view acls to: master Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,102 INFO [main] spark.SecurityManager: Changing modify acls to: master Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,102 INFO [main] spark.SecurityManager: Changing view acls groups to: Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,103 INFO [main] spark.SecurityManager: Changing modify acls groups to: Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,103 INFO [main] spark.SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users with view permissions: Set(master); groups with view permissions: Set(); users with modify permissions: Set(master); groups with modify permissions: Set() Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,419 INFO [main] util.Utils: Successfully started service 'sparkDriver' on port 36690. Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,447 INFO [main] spark.SparkEnv: Registering MapOutputTracker Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,469 INFO [main] spark.SparkEnv: Registering BlockManagerMaster Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,472 INFO [main] storage.BlockManagerMasterEndpoint: Using org.apache.spark.storage.DefaultTopologyMapper for getting topology information Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,473 INFO [main] storage.BlockManagerMasterEndpoint: BlockManagerMasterEndpoint up Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,483 INFO [main] storage.DiskBlockManager: Created local directory at /tmp/CreatedSparkTmp/blockmgr-8d5e86ac-eeb5-400d-abd1-fa53e05a5217 Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,500 INFO [main] memory.MemoryStore: MemoryStore started with capacity 3.0 GB Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,519 INFO [main] spark.SparkEnv: Registering OutputCommitCoordinator Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,600 INFO [main] util.log: Logging initialized @2310ms Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,674 INFO [main] server.Server: jetty-9.3.z-SNAPSHOT, build timestamp: unknown, git hash: unknown Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,694 INFO [main] server.Server: Started @2405ms Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,715 INFO [main] server.AbstractConnector: Started ServerConnector@5d39f2d8{HTTP/1.1,[http/1.1]}{0.0.0.0:4040} Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,716 INFO [main] util.Utils: Successfully started service 'SparkUI' on port 4040. Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,751 INFO [main] handler.ContextHandler: Started o.s.j.s.ServletContextHandler@1d782abe{/jobs,null,AVAILABLE,@Spark} Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,752 INFO [main] handler.ContextHandler: Started o.s.j.s.ServletContextHandler@37c5fc56{/jobs/json,null,AVAILABLE,@Spark} Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,753 INFO [main] handler.ContextHandler: Started o.s.j.s.ServletContextHandler@1c025cb{/jobs/job,null,AVAILABLE,@Spark} Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,754 INFO [main] handler.ContextHandler: Started o.s.j.s.ServletContextHandler@68809cc7{/jobs/job/json,null,AVAILABLE,@Spark} Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,755 INFO [main] handler.ContextHandler: Started o.s.j.s.ServletContextHandler@703feacd{/stages,null,AVAILABLE,@Spark} Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,756 INFO [main] handler.ContextHandler: Started o.s.j.s.ServletContextHandler@7051777c{/stages/json,null,AVAILABLE,@Spark} Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,756 INFO [main] handler.ContextHandler: Started o.s.j.s.ServletContextHandler@3241713e{/stages/stage,null,AVAILABLE,@Spark} Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,758 INFO [main] handler.ContextHandler: Started o.s.j.s.ServletContextHandler@2abc224d{/stages/stage/json,null,AVAILABLE,@Spark} Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,759 INFO [main] handler.ContextHandler: Started o.s.j.s.ServletContextHandler@13cd7ea5{/stages/pool,null,AVAILABLE,@Spark} Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,760 INFO [main] handler.ContextHandler: Started o.s.j.s.ServletContextHandler@102d92c4{/stages/pool/json,null,AVAILABLE,@Spark} Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,761 INFO [main] handler.ContextHandler: Started o.s.j.s.ServletContextHandler@2b97cc1f{/storage,null,AVAILABLE,@Spark} Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,762 INFO [main] handler.ContextHandler: Started o.s.j.s.ServletContextHandler@60723d6a{/storage/json,null,AVAILABLE,@Spark} Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,763 INFO [main] handler.ContextHandler: Started o.s.j.s.ServletContextHandler@18324f97{/storage/rdd,null,AVAILABLE,@Spark} Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,764 INFO [main] handler.ContextHandler: Started o.s.j.s.ServletContextHandler@64f555e7{/storage/rdd/json,null,AVAILABLE,@Spark} Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,765 INFO [main] handler.ContextHandler: Started o.s.j.s.ServletContextHandler@71178a52{/environment,null,AVAILABLE,@Spark} Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,766 INFO [main] handler.ContextHandler: Started o.s.j.s.ServletContextHandler@ff6077{/environment/json,null,AVAILABLE,@Spark} Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,767 INFO [main] handler.ContextHandler: Started o.s.j.s.ServletContextHandler@abbc908{/executors,null,AVAILABLE,@Spark} Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,768 INFO [main] handler.ContextHandler: Started o.s.j.s.ServletContextHandler@44afefd5{/executors/json,null,AVAILABLE,@Spark} Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,769 INFO [main] handler.ContextHandler: Started o.s.j.s.ServletContextHandler@9a7a808{/executors/threadDump,null,AVAILABLE,@Spark} Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,778 INFO [main] handler.ContextHandler: Started o.s.j.s.ServletContextHandler@72209d93{/executors/threadDump/json,null,AVAILABLE,@Spark} Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,788 INFO [main] handler.ContextHandler: Started o.s.j.s.ServletContextHandler@2687f956{/static,null,AVAILABLE,@Spark} Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,789 INFO [main] handler.ContextHandler: Started o.s.j.s.ServletContextHandler@21ab988f{/,null,AVAILABLE,@Spark} Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,791 INFO [main] handler.ContextHandler: Started o.s.j.s.ServletContextHandler@29314cc9{/api,null,AVAILABLE,@Spark} Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,792 INFO [main] handler.ContextHandler: Started o.s.j.s.ServletContextHandler@6b1e7ad3{/jobs/job/kill,null,AVAILABLE,@Spark} Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,793 INFO [main] handler.ContextHandler: Started o.s.j.s.ServletContextHandler@63e5e5b4{/stages/stage/kill,null,AVAILABLE,@Spark} Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,796 INFO [main] ui.SparkUI: Bound SparkUI to 0.0.0.0, and started at http://192.168.1.6:4040 Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,839 INFO [main] spark.SparkContext: Added JAR file:/home/master/hbase-2.2.4/lib/hbase-replication-2.2.4.jar at spark://192.168.1.6:36690/jars/hbase-replication-2.2.4.jar with timestamp 1587315094838 Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,839 INFO [main] spark.SparkContext: Added JAR file:/home/master/hbase-2.2.4/lib/commons-math3-3.6.1.jar at spark://192.168.1.6:36690/jars/commons-math3-3.6.1.jar with timestamp 1587315094839 Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,840 INFO [main] spark.SparkContext: Added JAR file:/home/master/hbase-2.2.4/lib/hbase-it-2.2.4.jar at spark://192.168.1.6:36690/jars/hbase-it-2.2.4.jar with timestamp 1587315094840 Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,840 INFO [main] spark.SparkContext: Added JAR file:/home/master/hbase-2.2.4/lib/hbase-annotations-2.2.4-tests.jar at spark://192.168.1.6:36690/jars/hbase-annotations-2.2.4-tests.jar with timestamp 1587315094840 Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,840 INFO [main] spark.SparkContext: Added JAR file:/home/master/hbase-2.2.4/lib/jetty-util-ajax-9.3.27.v20190418.jar at spark://192.168.1.6:36690/jars/jetty-util-ajax-9.3.27.v20190418.jar with timestamp 1587315094840 Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,840 INFO [main] spark.SparkContext: Added JAR file:/home/master/hbase-2.2.4/lib/java-xmlbuilder-0.4.jar at spark://192.168.1.6:36690/jars/java-xmlbuilder-0.4.jar with timestamp 1587315094840 Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,840 INFO [main] spark.SparkContext: Added JAR file:/home/master/hbase-2.2.4/lib/hbase-client-2.2.4.jar at spark://192.168.1.6:36690/jars/hbase-client-2.2.4.jar with timestamp 1587315094840 Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,841 INFO [main] spark.SparkContext: Added JAR file:/home/master/hbase-2.2.4/lib/commons-codec-1.10.jar at spark://192.168.1.6:36690/jars/commons-codec-1.10.jar with timestamp 1587315094841 Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,841 INFO [main] spark.SparkContext: Added JAR file:/home/master/hbase-2.2.4/lib/jsch-0.1.54.jar at spark://192.168.1.6:36690/jars/jsch-0.1.54.jar with timestamp 1587315094841 Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,841 INFO [main] spark.SparkContext: Added JAR file:/home/master/hbase-2.2.4/lib/hadoop-mapreduce-client-app-2.8.5.jar at spark://192.168.1.6:36690/jars/hadoop-mapreduce-client-app-2.8.5.jar with timestamp 1587315094841 Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,843 INFO [main] spark.SparkContext: Added JAR file:/home/master/hbase-2.2.4/lib/commons-net-3.1.jar at spark://192.168.1.6:36690/jars/commons-net-3.1.jar with timestamp 1587315094843 Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,844 INFO [main] spark.SparkContext: Added JAR file:/home/master/hbase-2.2.4/lib/hbase-metrics-api-2.2.4.jar at spark://192.168.1.6:36690/jars/hbase-metrics-api-2.2.4.jar with timestamp 1587315094844 Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,844 INFO [main] spark.SparkContext: Added JAR file:/home/master/hbase-2.2.4/lib/commons-compress-1.4.1.jar at spark://192.168.1.6:36690/jars/commons-compress-1.4.1.jar with timestamp 1587315094844 Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,844 INFO [main] spark.SparkContext: Added JAR file:/home/master/hbase-2.2.4/lib/commons-configuration-1.6.jar at spark://192.168.1.6:36690/jars/commons-configuration-1.6.jar with timestamp 1587315094844 Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,844 INFO [main] spark.SparkContext: Added JAR file:/home/master/hbase-2.2.4/lib/hadoop-hdfs-2.8.5-tests.jar at spark://192.168.1.6:36690/jars/hadoop-hdfs-2.8.5-tests.jar with timestamp 1587315094844 Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,844 INFO [main] spark.SparkContext: Added JAR file:/home/master/hbase-2.2.4/lib/hbase-external-blockcache-2.2.4.jar at spark://192.168.1.6:36690/jars/hbase-external-blockcache-2.2.4.jar with timestamp 1587315094844 Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,845 INFO [main] spark.SparkContext: Added JAR file:/home/master/hbase-2.2.4/lib/hadoop-minicluster-2.8.5.jar at spark://192.168.1.6:36690/jars/hadoop-minicluster-2.8.5.jar with timestamp 1587315094845 Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,845 INFO [main] spark.SparkContext: Added JAR file:/home/master/hbase-2.2.4/lib/jetty-webapp-9.3.27.v20190418.jar at spark://192.168.1.6:36690/jars/jetty-webapp-9.3.27.v20190418.jar with timestamp 1587315094845 Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,845 INFO [main] spark.SparkContext: Added JAR file:/home/master/hbase-2.2.4/lib/hbase-hadoop2-compat-2.2.4-tests.jar at spark://192.168.1.6:36690/jars/hbase-hadoop2-compat-2.2.4-tests.jar with timestamp 1587315094845 Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,847 INFO [main] spark.SparkContext: Added JAR file:/home/master/hbase-2.2.4/lib/commons-lang-2.6.jar at spark://192.168.1.6:36690/jars/commons-lang-2.6.jar with timestamp 1587315094847 Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,847 INFO [main] spark.SparkContext: Added JAR file:/home/master/hbase-2.2.4/lib/hbase-common-2.2.4.jar at spark://192.168.1.6:36690/jars/hbase-common-2.2.4.jar with timestamp 1587315094847 Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,847 INFO [main] spark.SparkContext: Added JAR file:/home/master/hbase-2.2.4/lib/jackson-core-2.9.10.jar at spark://192.168.1.6:36690/jars/jackson-core-2.9.10.jar with timestamp 1587315094847 Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,848 INFO [main] spark.SparkContext: Added JAR file:/home/master/hbase-2.2.4/lib/hadoop-yarn-server-web-proxy-2.8.5.jar at spark://192.168.1.6:36690/jars/hadoop-yarn-server-web-proxy-2.8.5.jar with timestamp 1587315094848 Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,848 INFO [main] spark.SparkContext: Added JAR file:/home/master/hbase-2.2.4/lib/javassist-3.20.0-GA.jar at spark://192.168.1.6:36690/jars/javassist-3.20.0-GA.jar with timestamp 1587315094848 Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,848 INFO [main] spark.SparkContext: Added JAR file:/home/master/hbase-2.2.4/lib/hbase-hadoop2-compat-2.2.4.jar at spark://192.168.1.6:36690/jars/hbase-hadoop2-compat-2.2.4.jar with timestamp 1587315094848 Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,848 INFO [main] spark.SparkContext: Added JAR file:/home/master/hbase-2.2.4/lib/validation-api-1.1.0.Final.jar at spark://192.168.1.6:36690/jars/validation-api-1.1.0.Final.jar with timestamp 1587315094848 Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,848 INFO [main] spark.SparkContext: Added JAR file:/home/master/hbase-2.2.4/lib/hbase-thrift-2.2.4.jar at spark://192.168.1.6:36690/jars/hbase-thrift-2.2.4.jar with timestamp 1587315094848 Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,848 INFO [main] spark.SparkContext: Added JAR file:/home/master/hbase-2.2.4/lib/jets3t-0.9.0.jar at spark://192.168.1.6:36690/jars/jets3t-0.9.0.jar with timestamp 1587315094848 Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,849 INFO [main] spark.SparkContext: Added JAR file:/home/master/hbase-2.2.4/lib/jetty-util-6.1.26.jar at spark://192.168.1.6:36690/jars/jetty-util-6.1.26.jar with timestamp 1587315094849 Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,849 INFO [main] spark.SparkContext: Added JAR file:/home/master/hbase-2.2.4/lib/jaxb-api-2.2.12.jar at spark://192.168.1.6:36690/jars/jaxb-api-2.2.12.jar with timestamp 1587315094849 Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,849 INFO [main] spark.SparkContext: Added JAR file:/home/master/hbase-2.2.4/lib/hadoop-mapreduce-client-shuffle-2.8.5.jar at spark://192.168.1.6:36690/jars/hadoop-mapreduce-client-shuffle-2.8.5.jar with timestamp 1587315094849 Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,849 INFO [main] spark.SparkContext: Added JAR file:/home/master/hbase-2.2.4/lib/javax.el-3.0.1-b08.jar at spark://192.168.1.6:36690/jars/javax.el-3.0.1-b08.jar with timestamp 1587315094849 Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,849 INFO [main] spark.SparkContext: Added JAR file:/home/master/hbase-2.2.4/lib/jetty-jmx-9.3.27.v20190418.jar at spark://192.168.1.6:36690/jars/jetty-jmx-9.3.27.v20190418.jar with timestamp 1587315094849 Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,849 INFO [main] spark.SparkContext: Added JAR file:/home/master/hbase-2.2.4/lib/hadoop-common-2.8.5-tests.jar at spark://192.168.1.6:36690/jars/hadoop-common-2.8.5-tests.jar with timestamp 1587315094849 Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,849 INFO [main] spark.SparkContext: Added JAR file:/home/master/hbase-2.2.4/lib/hadoop-mapreduce-client-jobclient-2.8.5.jar at spark://192.168.1.6:36690/jars/hadoop-mapreduce-client-jobclient-2.8.5.jar with timestamp 1587315094849 Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,850 INFO [main] spark.SparkContext: Added JAR file:/home/master/hbase-2.2.4/lib/paranamer-2.3.jar at spark://192.168.1.6:36690/jars/paranamer-2.3.jar with timestamp 1587315094850 Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,850 INFO [main] spark.SparkContext: Added JAR file:/home/master/hbase-2.2.4/lib/jetty-sslengine-6.1.26.jar at spark://192.168.1.6:36690/jars/jetty-sslengine-6.1.26.jar with timestamp 1587315094850 Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,850 INFO [main] spark.SparkContext: Added JAR file:/home/master/hbase-2.2.4/lib/jersey-media-jaxb-2.25.1.jar at spark://192.168.1.6:36690/jars/jersey-media-jaxb-2.25.1.jar with timestamp 1587315094850 Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,850 INFO [main] spark.SparkContext: Added JAR file:/home/master/hbase-2.2.4/lib/hbase-endpoint-2.2.4.jar at spark://192.168.1.6:36690/jars/hbase-endpoint-2.2.4.jar with timestamp 1587315094850 Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,850 INFO [main] spark.SparkContext: Added JAR file:/home/master/hbase-2.2.4/lib/commons-collections-3.2.2.jar at spark://192.168.1.6:36690/jars/commons-collections-3.2.2.jar with timestamp 1587315094850 Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,850 INFO [main] spark.SparkContext: Added JAR file:/home/master/hbase-2.2.4/lib/hbase-zookeeper-2.2.4-tests.jar at spark://192.168.1.6:36690/jars/hbase-zookeeper-2.2.4-tests.jar with timestamp 1587315094850 Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,850 INFO [main] spark.SparkContext: Added JAR file:/home/master/hbase-2.2.4/lib/hadoop-yarn-api-2.8.5.jar at spark://192.168.1.6:36690/jars/hadoop-yarn-api-2.8.5.jar with timestamp 1587315094850 Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,850 INFO [main] spark.SparkContext: Added JAR file:/home/master/hbase-2.2.4/lib/jackson-core-asl-1.9.13.jar at spark://192.168.1.6:36690/jars/jackson-core-asl-1.9.13.jar with timestamp 1587315094850 Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,850 INFO [main] spark.SparkContext: Added JAR file:/home/master/hbase-2.2.4/lib/hbase-mapreduce-2.2.4-tests.jar at spark://192.168.1.6:36690/jars/hbase-mapreduce-2.2.4-tests.jar with timestamp 1587315094850 Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,851 INFO [main] spark.SparkContext: Added JAR file:/home/master/hbase-2.2.4/lib/jamon-runtime-2.4.1.jar at spark://192.168.1.6:36690/jars/jamon-runtime-2.4.1.jar with timestamp 1587315094851 Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,851 INFO [main] spark.SparkContext: Added JAR file:/home/master/hbase-2.2.4/lib/hadoop-yarn-server-tests-2.8.5-tests.jar at spark://192.168.1.6:36690/jars/hadoop-yarn-server-tests-2.8.5-tests.jar with timestamp 1587315094851 Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,851 INFO [main] spark.SparkContext: Added JAR file:/home/master/hbase-2.2.4/lib/netty-all-4.0.23.Final.jar at spark://192.168.1.6:36690/jars/netty-all-4.0.23.Final.jar with timestamp 1587315094851 Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,851 INFO [main] spark.SparkContext: Added JAR file:/home/master/hbase-2.2.4/lib/javax.servlet-api-3.1.0.jar at spark://192.168.1.6:36690/jars/javax.servlet-api-3.1.0.jar with timestamp 1587315094851 Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,859 INFO [main] spark.SparkContext: Added JAR file:/home/master/hbase-2.2.4/lib/hbase-common-2.2.4-tests.jar at spark://192.168.1.6:36690/jars/hbase-common-2.2.4-tests.jar with timestamp 1587315094859 Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,859 INFO [main] spark.SparkContext: Added JAR file:/home/master/hbase-2.2.4/lib/hk2-locator-2.5.0-b32.jar at spark://192.168.1.6:36690/jars/hk2-locator-2.5.0-b32.jar with timestamp 1587315094859 Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,859 INFO [main] spark.SparkContext: Added JAR file:/home/master/hbase-2.2.4/lib/jersey-client-2.25.1.jar at spark://192.168.1.6:36690/jars/jersey-client-2.25.1.jar with timestamp 1587315094859 Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,859 INFO [main] spark.SparkContext: Added JAR file:/home/master/hbase-2.2.4/lib/hbase-resource-bundle-2.2.4.jar at spark://192.168.1.6:36690/jars/hbase-resource-bundle-2.2.4.jar with timestamp 1587315094859 Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,859 INFO [main] spark.SparkContext: Added JAR file:/home/master/hbase-2.2.4/lib/jersey-common-2.25.1.jar at spark://192.168.1.6:36690/jars/jersey-common-2.25.1.jar with timestamp 1587315094859 Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,860 INFO [main] spark.SparkContext: Added JAR file:/home/master/hbase-2.2.4/lib/hbase-annotations-2.2.4.jar at spark://192.168.1.6:36690/jars/hbase-annotations-2.2.4.jar with timestamp 1587315094860 Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,860 INFO [main] spark.SparkContext: Added JAR file:/home/master/hbase-2.2.4/lib/jetty-util-9.3.27.v20190418.jar at spark://192.168.1.6:36690/jars/jetty-util-9.3.27.v20190418.jar with timestamp 1587315094860 Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,860 INFO [main] spark.SparkContext: Added JAR file:/home/master/hbase-2.2.4/lib/xmlenc-0.52.jar at spark://192.168.1.6:36690/jars/xmlenc-0.52.jar with timestamp 1587315094860 Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,860 INFO [main] spark.SparkContext: Added JAR file:/home/master/hbase-2.2.4/lib/apacheds-kerberos-codec-2.0.0-M15.jar at spark://192.168.1.6:36690/jars/apacheds-kerberos-codec-2.0.0-M15.jar with timestamp 1587315094860 Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,860 INFO [main] spark.SparkContext: Added JAR file:/home/master/hbase-2.2.4/lib/javax.annotation-api-1.2.jar at spark://192.168.1.6:36690/jars/javax.annotation-api-1.2.jar with timestamp 1587315094860 Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,860 INFO [main] spark.SparkContext: Added JAR file:/home/master/hbase-2.2.4/lib/error_prone_annotations-2.3.3.jar at spark://192.168.1.6:36690/jars/error_prone_annotations-2.3.3.jar with timestamp 1587315094860 Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,860 INFO [main] spark.SparkContext: Added JAR file:/home/master/hbase-2.2.4/lib/junit-4.12.jar at spark://192.168.1.6:36690/jars/junit-4.12.jar with timestamp 1587315094860 Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,860 INFO [main] spark.SparkContext: Added JAR file:/home/master/hbase-2.2.4/lib/jetty-server-9.3.27.v20190418.jar at spark://192.168.1.6:36690/jars/jetty-server-9.3.27.v20190418.jar with timestamp 1587315094860 Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,861 INFO [main] spark.SparkContext: Added JAR file:/home/master/hbase-2.2.4/lib/hadoop-yarn-common-2.8.5.jar at spark://192.168.1.6:36690/jars/hadoop-yarn-common-2.8.5.jar with timestamp 1587315094861 Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,861 INFO [main] spark.SparkContext: Added JAR file:/home/master/hbase-2.2.4/lib/javax.inject-2.5.0-b32.jar at spark://192.168.1.6:36690/jars/javax.inject-2.5.0-b32.jar with timestamp 1587315094861 Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,861 INFO [main] spark.SparkContext: Added JAR file:/home/master/hbase-2.2.4/lib/hbase-protocol-shaded-2.2.4.jar at spark://192.168.1.6:36690/jars/hbase-protocol-shaded-2.2.4.jar with timestamp 1587315094861 Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,861 INFO [main] spark.SparkContext: Added JAR file:/home/master/hbase-2.2.4/lib/jersey-guava-2.25.1.jar at spark://192.168.1.6:36690/jars/jersey-guava-2.25.1.jar with timestamp 1587315094861 Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,861 INFO [main] spark.SparkContext: Added JAR file:/home/master/hbase-2.2.4/lib/libthrift-0.12.0.jar at spark://192.168.1.6:36690/jars/libthrift-0.12.0.jar with timestamp 1587315094861 Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,867 INFO [main] spark.SparkContext: Added JAR file:/home/master/hbase-2.2.4/lib/jaxb-impl-2.2.3-1.jar at spark://192.168.1.6:36690/jars/jaxb-impl-2.2.3-1.jar with timestamp 1587315094867 Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,867 INFO [main] spark.SparkContext: Added JAR file:/home/master/hbase-2.2.4/lib/jersey-server-2.25.1.jar at spark://192.168.1.6:36690/jars/jersey-server-2.25.1.jar with timestamp 1587315094867 Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,867 INFO [main] spark.SparkContext: Added JAR file:/home/master/hbase-2.2.4/lib/guice-3.0.jar at spark://192.168.1.6:36690/jars/guice-3.0.jar with timestamp 1587315094867 Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,868 INFO [main] spark.SparkContext: Added JAR file:/home/master/hbase-2.2.4/lib/javax.servlet.jsp-api-2.3.1.jar at spark://192.168.1.6:36690/jars/javax.servlet.jsp-api-2.3.1.jar with timestamp 1587315094867 Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,868 INFO [main] spark.SparkContext: Added JAR file:/home/master/hbase-2.2.4/lib/httpclient-4.5.3.jar at spark://192.168.1.6:36690/jars/httpclient-4.5.3.jar with timestamp 1587315094868 Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,868 INFO [main] spark.SparkContext: Added JAR file:/home/master/hbase-2.2.4/lib/hadoop-client-2.8.5.jar at spark://192.168.1.6:36690/jars/hadoop-client-2.8.5.jar with timestamp 1587315094868 Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,868 INFO [main] spark.SparkContext: Added JAR file:/home/master/hbase-2.2.4/lib/avro-1.7.7.jar at spark://192.168.1.6:36690/jars/avro-1.7.7.jar with timestamp 1587315094868 Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,868 INFO [main] spark.SparkContext: Added JAR file:/home/master/hbase-2.2.4/lib/hadoop-yarn-server-resourcemanager-2.8.5.jar at spark://192.168.1.6:36690/jars/hadoop-yarn-server-resourcemanager-2.8.5.jar with timestamp 1587315094868 Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,868 INFO [main] spark.SparkContext: Added JAR file:/home/master/hbase-2.2.4/lib/hamcrest-core-1.3.jar at spark://192.168.1.6:36690/jars/hamcrest-core-1.3.jar with timestamp 1587315094868 Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,868 INFO [main] spark.SparkContext: Added JAR file:/home/master/hbase-2.2.4/lib/javax.activation-1.2.0.jar at spark://192.168.1.6:36690/jars/javax.activation-1.2.0.jar with timestamp 1587315094868 Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,868 INFO [main] spark.SparkContext: Added JAR file:/home/master/hbase-2.2.4/lib/guice-servlet-3.0.jar at spark://192.168.1.6:36690/jars/guice-servlet-3.0.jar with timestamp 1587315094868 Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,868 INFO [main] spark.SparkContext: Added JAR file:/home/master/hbase-2.2.4/lib/hbase-shell-2.2.4.jar at spark://192.168.1.6:36690/jars/hbase-shell-2.2.4.jar with timestamp 1587315094868 Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,869 INFO [main] spark.SparkContext: Added JAR file:/home/master/hbase-2.2.4/lib/metrics-core-3.2.6.jar at spark://192.168.1.6:36690/jars/metrics-core-3.2.6.jar with timestamp 1587315094869 Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,869 INFO [main] spark.SparkContext: Added JAR file:/home/master/hbase-2.2.4/lib/hbase-server-2.2.4-tests.jar at spark://192.168.1.6:36690/jars/hbase-server-2.2.4-tests.jar with timestamp 1587315094869 Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,869 INFO [main] spark.SparkContext: Added JAR file:/home/master/hbase-2.2.4/lib/commons-math-2.2.jar at spark://192.168.1.6:36690/jars/commons-math-2.2.jar with timestamp 1587315094869 Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,869 INFO [main] spark.SparkContext: Added JAR file:/home/master/hbase-2.2.4/lib/javax.ws.rs-api-2.0.1.jar at spark://192.168.1.6:36690/jars/javax.ws.rs-api-2.0.1.jar with timestamp 1587315094869 Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,869 INFO [main] spark.SparkContext: Added JAR file:/home/master/hbase-2.2.4/lib/okio-1.4.0.jar at spark://192.168.1.6:36690/jars/okio-1.4.0.jar with timestamp 1587315094869 Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,869 INFO [main] spark.SparkContext: Added JAR file:/home/master/hbase-2.2.4/lib/aopalliance-1.0.jar at spark://192.168.1.6:36690/jars/aopalliance-1.0.jar with timestamp 1587315094869 Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,869 INFO [main] spark.SparkContext: Added JAR file:/home/master/hbase-2.2.4/lib/hadoop-auth-2.8.5.jar at spark://192.168.1.6:36690/jars/hadoop-auth-2.8.5.jar with timestamp 1587315094869 Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,869 INFO [main] spark.SparkContext: Added JAR file:/home/master/hbase-2.2.4/lib/jetty-security-9.3.27.v20190418.jar at spark://192.168.1.6:36690/jars/jetty-security-9.3.27.v20190418.jar with timestamp 1587315094869 Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,870 INFO [main] spark.SparkContext: Added JAR file:/home/master/hbase-2.2.4/lib/hk2-utils-2.5.0-b32.jar at spark://192.168.1.6:36690/jars/hk2-utils-2.5.0-b32.jar with timestamp 1587315094870 Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,870 INFO [main] spark.SparkContext: Added JAR file:/home/master/hbase-2.2.4/lib/commons-daemon-1.0.13.jar at spark://192.168.1.6:36690/jars/commons-daemon-1.0.13.jar with timestamp 1587315094870 Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,870 INFO [main] spark.SparkContext: Added JAR file:/home/master/hbase-2.2.4/lib/hadoop-hdfs-2.8.5.jar at spark://192.168.1.6:36690/jars/hadoop-hdfs-2.8.5.jar with timestamp 1587315094870 Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,870 INFO [main] spark.SparkContext: Added JAR file:/home/master/hbase-2.2.4/lib/jackson-jaxrs-json-provider-2.9.10.jar at spark://192.168.1.6:36690/jars/jackson-jaxrs-json-provider-2.9.10.jar with timestamp 1587315094870 Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,870 INFO [main] spark.SparkContext: Added JAR file:/home/master/hbase-2.2.4/lib/apacheds-i18n-2.0.0-M15.jar at spark://192.168.1.6:36690/jars/apacheds-i18n-2.0.0-M15.jar with timestamp 1587315094870 Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,870 INFO [main] spark.SparkContext: Added JAR file:/home/master/hbase-2.2.4/lib/okhttp-2.4.0.jar at spark://192.168.1.6:36690/jars/okhttp-2.4.0.jar with timestamp 1587315094870 Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,870 INFO [main] spark.SparkContext: Added JAR file:/home/master/hbase-2.2.4/lib/protobuf-java-2.5.0.jar at spark://192.168.1.6:36690/jars/protobuf-java-2.5.0.jar with timestamp 1587315094870 Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,870 INFO [main] spark.SparkContext: Added JAR file:/home/master/hbase-2.2.4/lib/jetty-io-9.3.27.v20190418.jar at spark://192.168.1.6:36690/jars/jetty-io-9.3.27.v20190418.jar with timestamp 1587315094870 Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,871 INFO [main] spark.SparkContext: Added JAR file:/home/master/hbase-2.2.4/lib/hbase-shaded-protobuf-2.2.1.jar at spark://192.168.1.6:36690/jars/hbase-shaded-protobuf-2.2.1.jar with timestamp 1587315094871 Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,871 INFO [main] spark.SparkContext: Added JAR file:/home/master/hbase-2.2.4/lib/jackson-mapper-asl-1.9.13.jar at spark://192.168.1.6:36690/jars/jackson-mapper-asl-1.9.13.jar with timestamp 1587315094871 Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,871 INFO [main] spark.SparkContext: Added JAR file:/home/master/hbase-2.2.4/lib/hadoop-yarn-server-common-2.8.5.jar at spark://192.168.1.6:36690/jars/hadoop-yarn-server-common-2.8.5.jar with timestamp 1587315094871 Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,871 INFO [main] spark.SparkContext: Added JAR file:/home/master/hbase-2.2.4/lib/hadoop-hdfs-client-2.8.5.jar at spark://192.168.1.6:36690/jars/hadoop-hdfs-client-2.8.5.jar with timestamp 1587315094871 Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,871 INFO [main] spark.SparkContext: Added JAR file:/home/master/hbase-2.2.4/lib/commons-lang3-3.6.jar at spark://192.168.1.6:36690/jars/commons-lang3-3.6.jar with timestamp 1587315094871 Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,871 INFO [main] spark.SparkContext: Added JAR file:/home/master/hbase-2.2.4/lib/commons-crypto-1.0.0.jar at spark://192.168.1.6:36690/jars/commons-crypto-1.0.0.jar with timestamp 1587315094871 Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,879 INFO [main] spark.SparkContext: Added JAR file:/home/master/hbase-2.2.4/lib/jcip-annotations-1.0-1.jar at spark://192.168.1.6:36690/jars/jcip-annotations-1.0-1.jar with timestamp 1587315094879 Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,879 INFO [main] spark.SparkContext: Added JAR file:/home/master/hbase-2.2.4/lib/hbase-shaded-miscellaneous-2.2.1.jar at spark://192.168.1.6:36690/jars/hbase-shaded-miscellaneous-2.2.1.jar with timestamp 1587315094879 Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,879 INFO [main] spark.SparkContext: Added JAR file:/home/master/hbase-2.2.4/lib/api-asn1-api-1.0.0-M20.jar at spark://192.168.1.6:36690/jars/api-asn1-api-1.0.0-M20.jar with timestamp 1587315094879 Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,879 INFO [main] spark.SparkContext: Added JAR file:/home/master/hbase-2.2.4/lib/commons-digester-1.8.jar at spark://192.168.1.6:36690/jars/commons-digester-1.8.jar with timestamp 1587315094879 Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,880 INFO [main] spark.SparkContext: Added JAR file:/home/master/hbase-2.2.4/lib/joni-2.1.11.jar at spark://192.168.1.6:36690/jars/joni-2.1.11.jar with timestamp 1587315094880 Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,880 INFO [main] spark.SparkContext: Added JAR file:/home/master/hbase-2.2.4/lib/hbase-server-2.2.4.jar at spark://192.168.1.6:36690/jars/hbase-server-2.2.4.jar with timestamp 1587315094880 Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,880 INFO [main] spark.SparkContext: Added JAR file:/home/master/hbase-2.2.4/lib/hadoop-distcp-2.8.5.jar at spark://192.168.1.6:36690/jars/hadoop-distcp-2.8.5.jar with timestamp 1587315094880 Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,889 INFO [main] spark.SparkContext: Added JAR file:/home/master/hbase-2.2.4/lib/hbase-rsgroup-2.2.4-tests.jar at spark://192.168.1.6:36690/jars/hbase-rsgroup-2.2.4-tests.jar with timestamp 1587315094889 Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,889 INFO [main] spark.SparkContext: Added JAR file:/home/master/hbase-2.2.4/lib/leveldbjni-all-1.8.jar at spark://192.168.1.6:36690/jars/leveldbjni-all-1.8.jar with timestamp 1587315094889 Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,890 INFO [main] spark.SparkContext: Added JAR file:/home/master/hbase-2.2.4/lib/nimbus-jose-jwt-4.41.1.jar at spark://192.168.1.6:36690/jars/nimbus-jose-jwt-4.41.1.jar with timestamp 1587315094890 Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,890 INFO [main] spark.SparkContext: Added JAR file:/home/master/hbase-2.2.4/lib/curator-client-4.0.0.jar at spark://192.168.1.6:36690/jars/curator-client-4.0.0.jar with timestamp 1587315094890 Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,890 INFO [main] spark.SparkContext: Added JAR file:/home/master/hbase-2.2.4/lib/hbase-hadoop-compat-2.2.4.jar at spark://192.168.1.6:36690/jars/hbase-hadoop-compat-2.2.4.jar with timestamp 1587315094890 Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,890 INFO [main] spark.SparkContext: Added JAR file:/home/master/hbase-2.2.4/lib/jackson-databind-2.9.10.1.jar at spark://192.168.1.6:36690/jars/jackson-databind-2.9.10.1.jar with timestamp 1587315094890 Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,890 INFO [main] spark.SparkContext: Added JAR file:/home/master/hbase-2.2.4/lib/jackson-module-jaxb-annotations-2.9.10.jar at spark://192.168.1.6:36690/jars/jackson-module-jaxb-annotations-2.9.10.jar with timestamp 1587315094890 Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,890 INFO [main] spark.SparkContext: Added JAR file:/home/master/hbase-2.2.4/lib/hk2-api-2.5.0-b32.jar at spark://192.168.1.6:36690/jars/hk2-api-2.5.0-b32.jar with timestamp 1587315094890 Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,890 INFO [main] spark.SparkContext: Added JAR file:/home/master/hbase-2.2.4/lib/hadoop-common-2.8.5.jar at spark://192.168.1.6:36690/jars/hadoop-common-2.8.5.jar with timestamp 1587315094890 Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,890 INFO [main] spark.SparkContext: Added JAR file:/home/master/hbase-2.2.4/lib/hbase-rsgroup-2.2.4.jar at spark://192.168.1.6:36690/jars/hbase-rsgroup-2.2.4.jar with timestamp 1587315094890 Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,891 INFO [main] spark.SparkContext: Added JAR file:/home/master/hbase-2.2.4/lib/hadoop-annotations-2.8.5.jar at spark://192.168.1.6:36690/jars/hadoop-annotations-2.8.5.jar with timestamp 1587315094890 Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,891 INFO [main] spark.SparkContext: Added JAR file:/home/master/hbase-2.2.4/lib/hadoop-mapreduce-client-core-2.8.5.jar at spark://192.168.1.6:36690/jars/hadoop-mapreduce-client-core-2.8.5.jar with timestamp 1587315094891 Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,891 INFO [main] spark.SparkContext: Added JAR file:/home/master/hbase-2.2.4/lib/jackson-annotations-2.9.10.jar at spark://192.168.1.6:36690/jars/jackson-annotations-2.9.10.jar with timestamp 1587315094891 Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,891 INFO [main] spark.SparkContext: Added JAR file:/home/master/hbase-2.2.4/lib/hbase-rest-2.2.4.jar at spark://192.168.1.6:36690/jars/hbase-rest-2.2.4.jar with timestamp 1587315094891 Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,891 INFO [main] spark.SparkContext: Added JAR file:/home/master/hbase-2.2.4/lib/gson-2.2.4.jar at spark://192.168.1.6:36690/jars/gson-2.2.4.jar with timestamp 1587315094891 Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,891 INFO [main] spark.SparkContext: Added JAR file:/home/master/hbase-2.2.4/lib/disruptor-3.3.6.jar at spark://192.168.1.6:36690/jars/disruptor-3.3.6.jar with timestamp 1587315094891 Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,891 INFO [main] spark.SparkContext: Added JAR file:/home/master/hbase-2.2.4/lib/httpcore-4.4.6.jar at spark://192.168.1.6:36690/jars/httpcore-4.4.6.jar with timestamp 1587315094891 Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,891 INFO [main] spark.SparkContext: Added JAR file:/home/master/hbase-2.2.4/lib/curator-test-2.7.1.jar at spark://192.168.1.6:36690/jars/curator-test-2.7.1.jar with timestamp 1587315094891 Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,891 INFO [main] spark.SparkContext: Added JAR file:/home/master/hbase-2.2.4/lib/hbase-protocol-2.2.4.jar at spark://192.168.1.6:36690/jars/hbase-protocol-2.2.4.jar with timestamp 1587315094891 Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,891 INFO [main] spark.SparkContext: Added JAR file:/home/master/hbase-2.2.4/lib/hadoop-yarn-server-applicationhistoryservice-2.8.5.jar at spark://192.168.1.6:36690/jars/hadoop-yarn-server-applicationhistoryservice-2.8.5.jar with timestamp 1587315094891 Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,892 INFO [main] spark.SparkContext: Added JAR file:/home/master/hbase-2.2.4/lib/commons-cli-1.2.jar at spark://192.168.1.6:36690/jars/commons-cli-1.2.jar with timestamp 1587315094892 Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,892 INFO [main] spark.SparkContext: Added JAR file:/home/master/hbase-2.2.4/lib/hadoop-mapreduce-client-hs-2.8.5.jar at spark://192.168.1.6:36690/jars/hadoop-mapreduce-client-hs-2.8.5.jar with timestamp 1587315094892 Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,892 INFO [main] spark.SparkContext: Added JAR file:/home/master/hbase-2.2.4/lib/spymemcached-2.12.2.jar at spark://192.168.1.6:36690/jars/spymemcached-2.12.2.jar with timestamp 1587315094892 Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,892 INFO [main] spark.SparkContext: Added JAR file:/home/master/hbase-2.2.4/lib/hbase-examples-2.2.4.jar at spark://192.168.1.6:36690/jars/hbase-examples-2.2.4.jar with timestamp 1587315094892 Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,892 INFO [main] spark.SparkContext: Added JAR file:/home/master/hbase-2.2.4/lib/snappy-java-1.0.5.jar at spark://192.168.1.6:36690/jars/snappy-java-1.0.5.jar with timestamp 1587315094892 Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,892 INFO [main] spark.SparkContext: Added JAR file:/home/master/hbase-2.2.4/lib/commons-beanutils-core-1.8.0.jar at spark://192.168.1.6:36690/jars/commons-beanutils-core-1.8.0.jar with timestamp 1587315094892 Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,892 INFO [main] spark.SparkContext: Added JAR file:/home/master/hbase-2.2.4/lib/hbase-http-2.2.4.jar at spark://192.168.1.6:36690/jars/hbase-http-2.2.4.jar with timestamp 1587315094892 Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,892 INFO [main] spark.SparkContext: Added JAR file:/home/master/hbase-2.2.4/lib/hbase-shaded-netty-2.2.1.jar at spark://192.168.1.6:36690/jars/hbase-shaded-netty-2.2.1.jar with timestamp 1587315094892 Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,893 INFO [main] spark.SparkContext: Added JAR file:/home/master/hbase-2.2.4/lib/hbase-hbtop-2.2.4.jar at spark://192.168.1.6:36690/jars/hbase-hbtop-2.2.4.jar with timestamp 1587315094892 Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,893 INFO [main] spark.SparkContext: Added JAR file:/home/master/hbase-2.2.4/lib/hbase-it-2.2.4-tests.jar at spark://192.168.1.6:36690/jars/hbase-it-2.2.4-tests.jar with timestamp 1587315094893 Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,893 INFO [main] spark.SparkContext: Added JAR file:/home/master/hbase-2.2.4/lib/jetty-servlet-9.3.27.v20190418.jar at spark://192.168.1.6:36690/jars/jetty-servlet-9.3.27.v20190418.jar with timestamp 1587315094893 Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,893 INFO [main] spark.SparkContext: Added JAR file:/home/master/hbase-2.2.4/lib/hbase-metrics-2.2.4.jar at spark://192.168.1.6:36690/jars/hbase-metrics-2.2.4.jar with timestamp 1587315094893 Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,893 INFO [main] spark.SparkContext: Added JAR file:/home/master/hbase-2.2.4/lib/commons-io-2.5.jar at spark://192.168.1.6:36690/jars/commons-io-2.5.jar with timestamp 1587315094893 Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,893 INFO [main] spark.SparkContext: Added JAR file:/home/master/hbase-2.2.4/lib/jetty-http-9.3.27.v20190418.jar at spark://192.168.1.6:36690/jars/jetty-http-9.3.27.v20190418.jar with timestamp 1587315094893 Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,893 INFO [main] spark.SparkContext: Added JAR file:/home/master/hbase-2.2.4/lib/aopalliance-repackaged-2.5.0-b32.jar at spark://192.168.1.6:36690/jars/aopalliance-repackaged-2.5.0-b32.jar with timestamp 1587315094893 Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,893 INFO [main] spark.SparkContext: Added JAR file:/home/master/hbase-2.2.4/lib/curator-framework-4.0.0.jar at spark://192.168.1.6:36690/jars/curator-framework-4.0.0.jar with timestamp 1587315094893 Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,893 INFO [main] spark.SparkContext: Added JAR file:/home/master/hbase-2.2.4/lib/asm-3.1.jar at spark://192.168.1.6:36690/jars/asm-3.1.jar with timestamp 1587315094893 Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,893 INFO [main] spark.SparkContext: Added JAR file:/home/master/hbase-2.2.4/lib/zookeeper-3.4.10.jar at spark://192.168.1.6:36690/jars/zookeeper-3.4.10.jar with timestamp 1587315094893 Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,893 INFO [main] spark.SparkContext: Added JAR file:/home/master/hbase-2.2.4/lib/jetty-6.1.26.jar at spark://192.168.1.6:36690/jars/jetty-6.1.26.jar with timestamp 1587315094893 Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,894 INFO [main] spark.SparkContext: Added JAR file:/home/master/hbase-2.2.4/lib/guava-11.0.2.jar at spark://192.168.1.6:36690/jars/guava-11.0.2.jar with timestamp 1587315094894 Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,894 INFO [main] spark.SparkContext: Added JAR file:/home/master/hbase-2.2.4/lib/javax.servlet.jsp-2.3.2.jar at spark://192.168.1.6:36690/jars/javax.servlet.jsp-2.3.2.jar with timestamp 1587315094894 Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,894 INFO [main] spark.SparkContext: Added JAR file:/home/master/hbase-2.2.4/lib/jettison-1.3.8.jar at spark://192.168.1.6:36690/jars/jettison-1.3.8.jar with timestamp 1587315094894 Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,894 INFO [main] spark.SparkContext: Added JAR file:/home/master/hbase-2.2.4/lib/xz-1.0.jar at spark://192.168.1.6:36690/jars/xz-1.0.jar with timestamp 1587315094894 Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,894 INFO [main] spark.SparkContext: Added JAR file:/home/master/hbase-2.2.4/lib/jetty-xml-9.3.27.v20190418.jar at spark://192.168.1.6:36690/jars/jetty-xml-9.3.27.v20190418.jar with timestamp 1587315094894 Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,894 INFO [main] spark.SparkContext: Added JAR file:/home/master/hbase-2.2.4/lib/hbase-zookeeper-2.2.4.jar at spark://192.168.1.6:36690/jars/hbase-zookeeper-2.2.4.jar with timestamp 1587315094894 Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,894 INFO [main] spark.SparkContext: Added JAR file:/home/master/hbase-2.2.4/lib/jcodings-1.0.18.jar at spark://192.168.1.6:36690/jars/jcodings-1.0.18.jar with timestamp 1587315094894 Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,894 INFO [main] spark.SparkContext: Added JAR file:/home/master/hbase-2.2.4/lib/osgi-resource-locator-1.0.1.jar at spark://192.168.1.6:36690/jars/osgi-resource-locator-1.0.1.jar with timestamp 1587315094894 Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,894 INFO [main] spark.SparkContext: Added JAR file:/home/master/hbase-2.2.4/lib/api-util-1.0.0-M20.jar at spark://192.168.1.6:36690/jars/api-util-1.0.0-M20.jar with timestamp 1587315094894 Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,894 INFO [main] spark.SparkContext: Added JAR file:/home/master/hbase-2.2.4/lib/hbase-testing-util-2.2.4.jar at spark://192.168.1.6:36690/jars/hbase-testing-util-2.2.4.jar with timestamp 1587315094894 Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,894 INFO [main] spark.SparkContext: Added JAR file:/home/master/hbase-2.2.4/lib/hadoop-yarn-server-nodemanager-2.8.5.jar at spark://192.168.1.6:36690/jars/hadoop-yarn-server-nodemanager-2.8.5.jar with timestamp 1587315094894 Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,895 INFO [main] spark.SparkContext: Added JAR file:/home/master/hbase-2.2.4/lib/jackson-jaxrs-base-2.9.10.jar at spark://192.168.1.6:36690/jars/jackson-jaxrs-base-2.9.10.jar with timestamp 1587315094894 Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,895 INFO [main] spark.SparkContext: Added JAR file:/home/master/hbase-2.2.4/lib/hadoop-yarn-client-2.8.5.jar at spark://192.168.1.6:36690/jars/hadoop-yarn-client-2.8.5.jar with timestamp 1587315094895 Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,895 INFO [main] spark.SparkContext: Added JAR file:/home/master/hbase-2.2.4/lib/curator-recipes-4.0.0.jar at spark://192.168.1.6:36690/jars/curator-recipes-4.0.0.jar with timestamp 1587315094895 Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,895 INFO [main] spark.SparkContext: Added JAR file:/home/master/hbase-2.2.4/lib/hbase-hadoop-compat-2.2.4-tests.jar at spark://192.168.1.6:36690/jars/hbase-hadoop-compat-2.2.4-tests.jar with timestamp 1587315094895 Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,895 INFO [main] spark.SparkContext: Added JAR file:/home/master/hbase-2.2.4/lib/hadoop-mapreduce-client-common-2.8.5.jar at spark://192.168.1.6:36690/jars/hadoop-mapreduce-client-common-2.8.5.jar with timestamp 1587315094895 Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,895 INFO [main] spark.SparkContext: Added JAR file:/home/master/hbase-2.2.4/lib/hbase-mapreduce-2.2.4.jar at spark://192.168.1.6:36690/jars/hbase-mapreduce-2.2.4.jar with timestamp 1587315094895 Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,895 INFO [main] spark.SparkContext: Added JAR file:/home/master/hbase-2.2.4/lib/hbase-procedure-2.2.4.jar at spark://192.168.1.6:36690/jars/hbase-procedure-2.2.4.jar with timestamp 1587315094895 Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,895 INFO [main] spark.SparkContext: Added JAR file:/home/master/hbase-2.2.4/lib/jersey-container-servlet-core-2.25.1.jar at spark://192.168.1.6:36690/jars/jersey-container-servlet-core-2.25.1.jar with timestamp 1587315094895 Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,895 INFO [main] spark.SparkContext: Added JAR file:///home/master/hbase-2.2.4/lib/client-facing-thirdparty/htrace-core4-4.2.0-incubating.jar at spark://192.168.1.6:36690/jars/htrace-core4-4.2.0-incubating.jar with timestamp 1587315094895 Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,895 INFO [main] spark.SparkContext: Added JAR file:///home/master/NetBeansProjects/Libs/spark-stemming_2.10-0.2.1.jar at spark://192.168.1.6:36690/jars/spark-stemming_2.10-0.2.1.jar with timestamp 1587315094895 Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,895 INFO [main] spark.SparkContext: Added JAR file:///home/master/NetBeansProjects/Libs/spark-nlp_2.11-2.4.5.jar at spark://192.168.1.6:36690/jars/spark-nlp_2.11-2.4.5.jar with timestamp 1587315094895 Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,895 INFO [main] spark.SparkContext: Added JAR file:///home/master/NetBeansProjects/Libs/aws-java-sdk-1.11.764.jar at spark://192.168.1.6:36690/jars/aws-java-sdk-1.11.764.jar with timestamp 1587315094895 Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,896 INFO [main] spark.SparkContext: Added JAR file:///home/master/NetBeansProjects/Libs/shocon_2.13-1.0.0.jar at spark://192.168.1.6:36690/jars/shocon_2.13-1.0.0.jar with timestamp 1587315094896 Apr 19, 2020 5:51:34 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:34,896 INFO [main] spark.SparkContext: Added JAR file:/home/master/NetBeansProject/New/target/FirstApp-1.0-SNAPSHOT.jar at spark://192.168.1.6:36690/jars/FirstApp-1.0-SNAPSHOT.jar with timestamp 1587315094896 Apr 19, 2020 5:51:35 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:35,033 INFO [main] executor.Executor: Starting executor ID driver on host localhost Apr 19, 2020 5:51:35 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:35,112 INFO [main] util.Utils: Successfully started service 'org.apache.spark.network.netty.NettyBlockTransferService' on port 40544. Apr 19, 2020 5:51:35 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:35,112 INFO [main] netty.NettyBlockTransferService: Server created on 192.168.1.6:40544 Apr 19, 2020 5:51:35 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:35,114 INFO [main] storage.BlockManager: Using org.apache.spark.storage.RandomBlockReplicationPolicy for block replication policy Apr 19, 2020 5:51:35 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:35,154 INFO [main] storage.BlockManagerMaster: Registering BlockManager BlockManagerId(driver, 192.168.1.6, 40544, None) Apr 19, 2020 5:51:35 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:35,159 INFO [dispatcher-event-loop-2] storage.BlockManagerMasterEndpoint: Registering block manager 192.168.1.6:40544 with 3.0 GB RAM, BlockManagerId(driver, 192.168.1.6, 40544, None) Apr 19, 2020 5:51:35 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:35,164 INFO [main] storage.BlockManagerMaster: Registered BlockManager BlockManagerId(driver, 192.168.1.6, 40544, None) Apr 19, 2020 5:51:35 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:35,165 INFO [main] storage.BlockManager: Initialized BlockManager: BlockManagerId(driver, 192.168.1.6, 40544, None) Apr 19, 2020 5:51:35 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:35,348 INFO [main] handler.ContextHandler: Started o.s.j.s.ServletContextHandler@557eb543{/metrics/json,null,AVAILABLE,@Spark} Apr 19, 2020 5:51:35 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:35,695 INFO [main] memory.MemoryStore: Block broadcast_0 stored as values in memory (estimated size 236.7 KB, free 3.0 GB) Apr 19, 2020 5:51:35 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:35,776 INFO [main] memory.MemoryStore: Block broadcast_0_piece0 stored as bytes in memory (estimated size 22.9 KB, free 3.0 GB) Apr 19, 2020 5:51:35 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:35,778 INFO [dispatcher-event-loop-0] storage.BlockManagerInfo: Added broadcast_0_piece0 in memory on 192.168.1.6:40544 (size: 22.9 KB, free: 3.0 GB) Apr 19, 2020 5:51:35 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:35,782 INFO [main] spark.SparkContext: Created broadcast 0 from textFile at FirstLayer.java:47 Apr 19, 2020 5:51:35 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:35,852 INFO [main] memory.MemoryStore: Block broadcast_1 stored as values in memory (estimated size 236.7 KB, free 3.0 GB) Apr 19, 2020 5:51:35 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:35,866 INFO [main] memory.MemoryStore: Block broadcast_1_piece0 stored as bytes in memory (estimated size 22.9 KB, free 3.0 GB) Apr 19, 2020 5:51:35 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:35,868 INFO [dispatcher-event-loop-1] storage.BlockManagerInfo: Added broadcast_1_piece0 in memory on 192.168.1.6:40544 (size: 22.9 KB, free: 3.0 GB) Apr 19, 2020 5:51:35 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:35,869 INFO [main] spark.SparkContext: Created broadcast 1 from textFile at FirstLayer.java:66 Apr 19, 2020 5:51:35 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:35,930 INFO [main] mapred.FileInputFormat: Total input paths to process : 1 Apr 19, 2020 5:51:35 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:35,948 INFO [main] mapred.FileInputFormat: Total input paths to process : 1 Apr 19, 2020 5:51:36 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:36,281 INFO [ReadOnlyZKClient-localhost:2182@0x7c5d1d25] zookeeper.ZooKeeper: Client environment:zookeeper.version=3.4.6-1569965, built on 02/20/2014 09:09 GMT Apr 19, 2020 5:51:36 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:36,282 INFO [ReadOnlyZKClient-localhost:2182@0x7c5d1d25] zookeeper.ZooKeeper: Client environment:host.name=masterX Apr 19, 2020 5:51:36 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:36,282 INFO [ReadOnlyZKClient-localhost:2182@0x7c5d1d25] zookeeper.ZooKeeper: Client environment:java.version=1.8.0_201 Apr 19, 2020 5:51:36 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:36,283 INFO [ReadOnlyZKClient-localhost:2182@0x7c5d1d25] zookeeper.ZooKeeper: Client environment:java.vendor=Oracle Corporation Apr 19, 2020 5:51:36 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:36,283 INFO [ReadOnlyZKClient-localhost:2182@0x7c5d1d25] zookeeper.ZooKeeper: Client environment:java.home=/usr/lib/jvm/java-8-oracle/jre Apr 19, 2020 5:51:36 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:36,284 INFO [ReadOnlyZKClient-localhost:2182@0x7c5d1d25] zookeeper.ZooKeeper: k-2.4.0-bin-hadoop2.7/jars/hive-exec-1.2.1.spark2.jar:/home/master/spark-2.4.0-bin-hadoop2.7/jars/orc-core-1.5.2-nohive.jar:/home/master/spark-2.4.0-bin-hadoop2.7/jars/hk2-api-2.4.0-b34.jar:/home/master/spark-2.4.0-bin-hadoop2.7/jars/parquet-hadoop-bundle-1.6.0.jar:/home/master/spark-2.4.0-bin-hadoop2.7/jars/jsp-api-2.1.jar:/home/master/spark-2.4.0-bin-hadoop2.7/jars/antlr4-runtime-4.7.jar:/home/master/spark-2.4.0-bin-hadoop2.7/jars/spark-sketch_2.11-2.4.0.jar:/home/master/spark-2.4.0-bin-hadoop2.7/jars/arrow-format-0.10.0.jar:/home/master/spark-2.4.0-bin-hadoop2.7/jars/commons-dbcp-1.4.jar:/home/master/spark-2.4.0-bin-hadoop2.7/jars/spark-sql_2.11-2.4.0.jar:/home/master/spark-2.4.0-bin-hadoop2.7/jars/automaton-1.11-8.jar:/home/master/spark-2.4.0-bin-hadoop2.7/jars/jackson-xc-1.9.13.jar:/home/master/spark-2.4.0-bin-hadoop2.7/jars/kubernetes-model-2.0.0.jar:/home/master/spark-2.4.0-bin-hadoop2.7/jars/kubernetes-client-3.0.0.jar:/home/master/spark-2.4.0-bin-hadoop2.7/jars/py4j-0.10.7.jar Apr 19, 2020 5:51:36 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:36,284 INFO [ReadOnlyZKClient-localhost:2182@0x7c5d1d25] zookeeper.ZooKeeper: Client environment:java.library.path=/usr/java/packages/lib/amd64:/usr/lib64:/lib64:/lib:/usr/lib Apr 19, 2020 5:51:36 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:36,284 INFO [ReadOnlyZKClient-localhost:2182@0x7c5d1d25] zookeeper.ZooKeeper: Client environment:java.io.tmpdir=/tmp Apr 19, 2020 5:51:36 PM org.apache.spark.launcher.OutputRedirector redirect INFO: 2020-04-19 17:51:36,284 INFO [ReadOnlyZKClient-localhost:2182@0x7c5d1d25] zookeeper.ZooKeeper: Client environment:java.compiler=
Apr 19, 2020 5:51:36 PM org.apache.spark.launcher.OutputRedirector redirect
INFO: 2020-04-19 17:51:36,284 INFO [ReadOnlyZKClient-localhost:2182@0x7c5d1d25] zookeeper.ZooKeeper: Client environment:os.name=Linux
Apr 19, 2020 5:51:36 PM org.apache.spark.launcher.OutputRedirector redirect
INFO: 2020-04-19 17:51:36,284 INFO [ReadOnlyZKClient-localhost:2182@0x7c5d1d25] zookeeper.ZooKeeper: Client environment:os.arch=amd64
Apr 19, 2020 5:51:36 PM org.apache.spark.launcher.OutputRedirector redirect
INFO: 2020-04-19 17:51:36,284 INFO [ReadOnlyZKClient-localhost:2182@0x7c5d1d25] zookeeper.ZooKeeper: Client environment:os.version=4.4.0-148-generic
Apr 19, 2020 5:51:36 PM org.apache.spark.launcher.OutputRedirector redirect
INFO: 2020-04-19 17:51:36,284 INFO [ReadOnlyZKClient-localhost:2182@0x7c5d1d25] zookeeper.ZooKeeper: Client environment:user.name=master
Apr 19, 2020 5:51:36 PM org.apache.spark.launcher.OutputRedirector redirect
INFO: 2020-04-19 17:51:36,284 INFO [ReadOnlyZKClient-localhost:2182@0x7c5d1d25] zookeeper.ZooKeeper: Client environment:user.home=/home/master
Apr 19, 2020 5:51:36 PM org.apache.spark.launcher.OutputRedirector redirect
INFO: 2020-04-19 17:51:36,284 INFO [ReadOnlyZKClient-localhost:2182@0x7c5d1d25] zookeeper.ZooKeeper: Client environment:user.dir=/home/master/NetBeansProject/New
Apr 19, 2020 5:51:36 PM org.apache.spark.launcher.OutputRedirector redirect
INFO: 2020-04-19 17:51:36,287 INFO [ReadOnlyZKClient-localhost:2182@0x7c5d1d25] zookeeper.ZooKeeper: Initiating client connection, connectString=localhost:2182 sessionTimeout=90000 watcher=org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$27/1409093967@677dea1b
Apr 19, 2020 5:51:46 PM org.apache.spark.launcher.OutputRedirector redirect
INFO: 2020-04-19 17:51:46,417 INFO [ReadOnlyZKClient-localhost:2182@0x7c5d1d25-SendThread(masterX:2182)] zookeeper.ClientCnxn: Opening socket connection to server masterX/127.0.0.1:2182. Will not attempt to authenticate using SASL (unknown error)
Apr 19, 2020 5:51:46 PM org.apache.spark.launcher.OutputRedirector redirect
INFO: 2020-04-19 17:51:46,420 INFO [ReadOnlyZKClient-localhost:2182@0x7c5d1d25-SendThread(masterX:2182)] zookeeper.ClientCnxn: Socket connection established to masterX/127.0.0.1:2182, initiating session
Apr 19, 2020 5:51:46 PM org.apache.spark.launcher.OutputRedirector redirect
INFO: 2020-04-19 17:51:46,453 INFO [ReadOnlyZKClient-localhost:2182@0x7c5d1d25-SendThread(masterX:2182)] zookeeper.ClientCnxn: Session establishment complete on server masterX/127.0.0.1:2182, sessionid = 0x17193269bc9000b, negotiated timeout = 40000
Apr 19, 2020 5:51:47 PM org.apache.spark.launcher.OutputRedirector redirect
INFO: 2020-04-19 17:51:47,122 INFO [main] client.ConnectionImplementation: Closing master protocol: MasterService
Apr 19, 2020 5:51:47 PM org.apache.spark.launcher.OutputRedirector redirect
INFO: HBase is running!
Apr 19, 2020 5:51:47 PM org.apache.spark.launcher.OutputRedirector redirect
INFO: 2020-04-19 17:51:47,158 INFO [ReadOnlyZKClient-localhost:2182@0x7c5d1d25] zookeeper.ZooKeeper: Session: 0x17193269bc9000b closed
Apr 19, 2020 5:51:47 PM org.apache.spark.launcher.OutputRedirector redirect
INFO: 2020-04-19 17:51:47,159 INFO [ReadOnlyZKClient-localhost:2182@0x7c5d1d25-EventThread] zookeeper.ClientCnxn: EventThread shut down
Apr 19, 2020 5:51:47 PM org.apache.spark.launcher.OutputRedirector redirect
INFO: 2020-04-19 17:51:47,170 INFO [main] memory.MemoryStore: Block broadcast_2 stored as values in memory (estimated size 372.4 KB, free 3.0 GB)
Apr 19, 2020 5:51:47 PM org.apache.spark.launcher.OutputRedirector redirect
INFO: 2020-04-19 17:51:47,186 INFO [main] memory.MemoryStore: Block broadcast_2_piece0 stored as bytes in memory (estimated size 27.5 KB, free 3.0 GB)
Apr 19, 2020 5:51:47 PM org.apache.spark.launcher.OutputRedirector redirect
INFO: 2020-04-19 17:51:47,187 INFO [dispatcher-event-loop-2] storage.BlockManagerInfo: Added broadcast_2_piece0 in memory on 192.168.1.6:40544 (size: 27.5 KB, free: 3.0 GB)
Apr 19, 2020 5:51:47 PM org.apache.spark.launcher.OutputRedirector redirect
INFO: 2020-04-19 17:51:47,187 INFO [main] spark.SparkContext: Created broadcast 2 from newAPIHadoopRDD at ResourceLoading.java:418
Apr 19, 2020 5:51:48 PM org.apache.spark.launcher.OutputRedirector redirect
INFO: 2020-04-19 17:51:48,407 INFO [main] internal.SharedState: Setting hive.metastore.warehouse.dir ('null') to the value of spark.sql.warehouse.dir ('file:/home/master/NetBeansProject/New/spark-warehouse/').
Apr 19, 2020 5:51:48 PM org.apache.spark.launcher.OutputRedirector redirect
INFO: 2020-04-19 17:51:48,407 INFO [main] internal.SharedState: Warehouse path is 'file:/home/master/NetBeansProject/New/spark-warehouse/'.
Apr 19, 2020 5:51:48 PM org.apache.spark.launcher.OutputRedirector redirect
INFO: 2020-04-19 17:51:48,415 INFO [main] handler.ContextHandler: Started o.s.j.s.ServletContextHandler@fe08eaf{/SQL,null,AVAILABLE,@Spark}
Apr 19, 2020 5:51:48 PM org.apache.spark.launcher.OutputRedirector redirect
INFO: 2020-04-19 17:51:48,416 INFO [main] handler.ContextHandler: Started o.s.j.s.ServletContextHandler@6fd9dbe6{/SQL/json,null,AVAILABLE,@Spark}
Apr 19, 2020 5:51:48 PM org.apache.spark.launcher.OutputRedirector redirect
INFO: 2020-04-19 17:51:48,417 INFO [main] handler.ContextHandler: Started o.s.j.s.ServletContextHandler@5abbb273{/SQL/execution,null,AVAILABLE,@Spark}
Apr 19, 2020 5:51:48 PM org.apache.spark.launcher.OutputRedirector redirect
INFO: 2020-04-19 17:51:48,417 INFO [main] handler.ContextHandler: Started o.s.j.s.ServletContextHandler@25d9291a{/SQL/execution/json,null,AVAILABLE,@Spark}
Apr 19, 2020 5:51:48 PM org.apache.spark.launcher.OutputRedirector redirect
INFO: 2020-04-19 17:51:48,419 INFO [main] handler.ContextHandler: Started o.s.j.s.ServletContextHandler@70d687b8{/static/sql,null,AVAILABLE,@Spark}
Apr 19, 2020 5:51:48 PM org.apache.spark.launcher.OutputRedirector redirect
INFO: 2020-04-19 17:51:48,799 INFO [main] state.StateStoreCoordinatorRef: Registered StateStoreCoordinator endpoint
Apr 19, 2020 5:51:48 PM org.apache.spark.launcher.OutputRedirector redirect
INFO: 2020-04-19 17:51:48,960 WARN [main] sql.SparkSession$Builder: Using an existing SparkSession; some configuration may not take effect.
Apr 19, 2020 5:51:48 PM org.apache.spark.launcher.OutputRedirector redirect
INFO: 2.4.5
Apr 19, 2020 5:51:49 PM org.apache.spark.launcher.OutputRedirector redirect
INFO: Exception in thread "main" java.lang.NoSuchMethodError: com.typesafe.config.ConfigFactory.load()Lcom/typesafe/config/Config;
Apr 19, 2020 5:51:49 PM org.apache.spark.launcher.OutputRedirector redirect
INFO: at com.johnsnowlabs.util.ConfigLoader$.(ConfigLoader.scala:11)
Apr 19, 2020 5:51:49 PM org.apache.spark.launcher.OutputRedirector redirect
INFO: at com.johnsnowlabs.util.ConfigLoader$.(ConfigLoader.scala)
Apr 19, 2020 5:51:49 PM org.apache.spark.launcher.OutputRedirector redirect
INFO: at com.johnsnowlabs.util.ConfigHelper$.getConfigValue(ConfigHelper.scala:13)
Apr 19, 2020 5:51:49 PM org.apache.spark.launcher.OutputRedirector redirect
INFO: at com.johnsnowlabs.util.ConfigHelper$.getConfigValueOrElse(ConfigHelper.scala:20)
Apr 19, 2020 5:51:49 PM org.apache.spark.launcher.OutputRedirector redirect
INFO: at com.johnsnowlabs.util.ConfigHelper$.(ConfigHelper.scala:47)
Apr 19, 2020 5:51:49 PM org.apache.spark.launcher.OutputRedirector redirect
INFO: at com.johnsnowlabs.util.ConfigHelper$.(ConfigHelper.scala)
Apr 19, 2020 5:51:49 PM org.apache.spark.launcher.OutputRedirector redirect
INFO: at com.johnsnowlabs.nlp.pretrained.ResourceDownloader$.cacheFolder(ResourceDownloader.scala:63)
Apr 19, 2020 5:51:49 PM org.apache.spark.launcher.OutputRedirector redirect
INFO: at com.johnsnowlabs.nlp.pretrained.ResourceDownloader$$anonfun$3.apply(ResourceDownloader.scala:123)
Apr 19, 2020 5:51:49 PM org.apache.spark.launcher.OutputRedirector redirect
INFO: at com.johnsnowlabs.nlp.pretrained.ResourceDownloader$$anonfun$3.apply(ResourceDownloader.scala:123)
Apr 19, 2020 5:51:49 PM org.apache.spark.launcher.OutputRedirector redirect
INFO: at com.johnsnowlabs.nlp.pretrained.S3ResourceDownloader.(S3ResourceDownloader.scala:30)
Apr 19, 2020 5:51:49 PM org.apache.spark.launcher.OutputRedirector redirect
INFO: at com.johnsnowlabs.nlp.pretrained.ResourceDownloader$.(ResourceDownloader.scala:123)
Apr 19, 2020 5:51:49 PM org.apache.spark.launcher.OutputRedirector redirect
INFO: at com.johnsnowlabs.nlp.pretrained.ResourceDownloader$.(ResourceDownloader.scala)
Apr 19, 2020 5:51:49 PM org.apache.spark.launcher.OutputRedirector redirect
INFO: at com.johnsnowlabs.nlp.pretrained.PretrainedPipeline.(PretrainedPipeline.scala:21)
Apr 19, 2020 5:51:49 PM org.apache.spark.launcher.OutputRedirector redirect
INFO: at module3.VertexStemming.stemming(VertexStemming.java:96)
Apr 19, 2020 5:51:49 PM org.apache.spark.launcher.OutputRedirector redirect
INFO: at module3.VertexStemming.Run(VertexStemming.java:106)
Apr 19, 2020 5:51:49 PM org.apache.spark.launcher.OutputRedirector redirect
INFO: at main.FirstLayer.main(FirstLayer.java:139)
Apr 19, 2020 5:51:49 PM org.apache.spark.launcher.OutputRedirector redirect
INFO: at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
Apr 19, 2020 5:51:49 PM org.apache.spark.launcher.OutputRedirector redirect
INFO: at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
Apr 19, 2020 5:51:49 PM org.apache.spark.launcher.OutputRedirector redirect
INFO: at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
Apr 19, 2020 5:51:49 PM org.apache.spark.launcher.OutputRedirector redirect
INFO: at java.lang.reflect.Method.invoke(Method.java:498)
Apr 19, 2020 5:51:49 PM org.apache.spark.launcher.OutputRedirector redirect
INFO: at org.apache.spark.deploy.JavaMainApplication.start(SparkApplication.scala:52)
Apr 19, 2020 5:51:49 PM org.apache.spark.launcher.OutputRedirector redirect
INFO: at org.apache.spark.deploy.SparkSubmit.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:849)
Apr 19, 2020 5:51:49 PM org.apache.spark.launcher.OutputRedirector redirect
INFO: at org.apache.spark.deploy.SparkSubmit.doRunMain$1(SparkSubmit.scala:167)
Apr 19, 2020 5:51:49 PM org.apache.spark.launcher.OutputRedirector redirect
INFO: at org.apache.spark.deploy.SparkSubmit.submit(SparkSubmit.scala:195)
Apr 19, 2020 5:51:49 PM org.apache.spark.launcher.OutputRedirector redirect
INFO: at org.apache.spark.deploy.SparkSubmit.doSubmit(SparkSubmit.scala:86)
Apr 19, 2020 5:51:49 PM org.apache.spark.launcher.OutputRedirector redirect
INFO: at org.apache.spark.deploy.SparkSubmit$$anon$2.doSubmit(SparkSubmit.scala:924)
Apr 19, 2020 5:51:49 PM org.apache.spark.launcher.OutputRedirector redirect
INFO: at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:933)
Apr 19, 2020 5:51:49 PM org.apache.spark.launcher.OutputRedirector redirect
INFO: at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)
Apr 19, 2020 5:51:49 PM org.apache.spark.launcher.OutputRedirector redirect
INFO: 2020-04-19 17:51:49,039 INFO [Thread-1] spark.SparkContext: Invoking stop() from shutdown hook
Apr 19, 2020 5:51:49 PM org.apache.spark.launcher.OutputRedirector redirect
INFO: 2020-04-19 17:51:49,046 INFO [Thread-1] server.AbstractConnector: Stopped Spark@5d39f2d8{HTTP/1.1,[http/1.1]}{0.0.0.0:4040}
Apr 19, 2020 5:51:49 PM org.apache.spark.launcher.OutputRedirector redirect
INFO: 2020-04-19 17:51:49,048 INFO [Thread-1] ui.SparkUI: Stopped Spark web UI at http://192.168.1.6:4040
Apr 19, 2020 5:51:49 PM org.apache.spark.launcher.OutputRedirector redirect
INFO: 2020-04-19 17:51:49,071 INFO [dispatcher-event-loop-2] spark.MapOutputTrackerMasterEndpoint: MapOutputTrackerMasterEndpoint stopped!
Apr 19, 2020 5:51:49 PM org.apache.spark.launcher.OutputRedirector redirect
INFO: 2020-04-19 17:51:49,077 INFO [Thread-1] memory.MemoryStore: MemoryStore cleared
Apr 19, 2020 5:51:49 PM org.apache.spark.launcher.OutputRedirector redirect
INFO: 2020-04-19 17:51:49,077 INFO [Thread-1] storage.BlockManager: BlockManager stopped
Apr 19, 2020 5:51:49 PM org.apache.spark.launcher.OutputRedirector redirect
INFO: 2020-04-19 17:51:49,082 INFO [Thread-1] storage.BlockManagerMaster: BlockManagerMaster stopped
Apr 19, 2020 5:51:49 PM org.apache.spark.launcher.OutputRedirector redirect
INFO: 2020-04-19 17:51:49,085 INFO [dispatcher-event-loop-3] scheduler.OutputCommitCoordinator$OutputCommitCoordinatorEndpoint: OutputCommitCoordinator stopped!
Apr 19, 2020 5:51:49 PM org.apache.spark.launcher.OutputRedirector redirect
INFO: 2020-04-19 17:51:49,089 INFO [Thread-1] spark.SparkContext: Successfully stopped SparkContext
Apr 19, 2020 5:51:49 PM org.apache.spark.launcher.OutputRedirector redirect
INFO: 2020-04-19 17:51:49,089 INFO [Thread-1] util.ShutdownHookManager: Shutdown hook called
Apr 19, 2020 5:51:49 PM org.apache.spark.launcher.OutputRedirector redirect
INFO: 2020-04-19 17:51:49,090 INFO [Thread-1] util.ShutdownHookManager: Deleting directory /tmp/spark-2a11f070-26ff-49d8-bedc-1c849ef8e09f
Apr 19, 2020 5:51:49 PM org.apache.spark.launcher.OutputRedirector redirect
INFO: 2020-04-19 17:51:49,093 INFO [Thread-1] util.ShutdownHookManager: Deleting directory /tmp/CreatedSparkTmp/spark-13cb295b-726d-4170-98d7-7a73f91d8167
Apr 19, 2020 5:51:49 PM org.apache.spark.launcher.AbstractAppHandle setState
WARNING: Backend requested transition from final state FAILED to LOST.
Possible Solution
Looking forward to your assistance.
Steps to Reproduce
1. 2. 3. 4.
Context
I was trying to use one of the pipelines for stemming requirements.
Your Environment