first start elephant with the error and exit

lushuai2013 commented 7 years ago

[info] play - database [default] connected at jdbc:mysql://.../drelephant?characterEncoding=UTF-8 [error] c.j.b.ConnectionHandle - Database access problem. Killing off this connection and all remaining connections in the connection pool. SQL State = HY000 Oops, cannot start the server. java.sql.SQLException: Connection is closed! at com.jolbox.bonecp.ConnectionHandle.checkClosed(ConnectionHandle.java:459) at com.jolbox.bonecp.ConnectionHandle.prepareStatement(ConnectionHandle.java:1011) at play.api.db.evolutions.Evolutions$.prepare(Evolutions.scala:125) at play.api.db.evolutions.Evolutions$.updateLastProblem$1(Evolutions.scala:244)

superbobry commented 7 years ago

Could you give more details about your setup? this stacktrace alone is not enough to isolate the cause.

hereTac commented 7 years ago

1.install mysql 10.0.1.11 and i start mysql service 2.install dr-elephant 10.0.1.12 less conf/application.conf ... db.default.driver=com.mysql.jdbc.Driver db.default.url="jdbc:mysql://10.0.1.11:3306/drelephant?characterEncoding=UTF-8" db.default.user=drelephantuser db.default.password="drelephantpasswd" ... less app-conf/elephant.conf ... db_url=10.0.1.11 db_name=drelephant db_user=drelephantuser db_password="drelephantpasswd" ... less dr.log ... ESC[37minfoESC[0m] play - database [default] connected at jdbc:mysql://10.0.1.11/drelephant?characterEncoding=UTF-8 [ESC[31merrorESC[0m] c.j.b.ConnectionHandle - Database access problem. Killing off this connection and all remaining connections in the connection pool. SQL State = HY000 Oops, cannot start the server. java.sql.SQLException: Connection is closed! at com.jolbox.bonecp.ConnectionHandle.checkClosed(ConnectionHandle.java:459) at com.jolbox.bonecp.ConnectionHandle.prepareStatement(ConnectionHandle.java:1011) at play.api.db.evolutions.Evolutions$.prepare(Evolutions.scala:125) at play.api.db.evolutions.Evolutions$.updateLastProblem$1(Evolutions.scala:244) at play.api.db.evolutions.Evolutions$.applyScript(Evolutions.scala:271) at play.api.db.evolutions.EvolutionsPlugin$$anonfun$onStart$1$$anonfun$apply$1.apply$mcV$sp(Evolutions.scala:472) at play.api.db.evolutions.EvolutionsPlugin.withLock(Evolutions.scala:507) at play.api.db.evolutions.EvolutionsPlugin$$anonfun$onStart$1.apply(Evolutions.scala:461) at play.api.db.evolutions.EvolutionsPlugin$$anonfun$onStart$1.apply(Evolutions.scala:459) at scala.collection.immutable.List.foreach(List.scala:318) at play.api.db.evolutions.EvolutionsPlugin.onStart(Evolutions.scala:459) at play.api.Play$$anonfun$start$1$$anonfun$apply$mcV$sp$1.apply(Play.scala:88) at play.api.Play$$anonfun$start$1$$anonfun$apply$mcV$sp$1.apply(Play.scala:88) at scala.collection.immutable.List.foreach(List.scala:318) at play.api.Play$$anonfun$start$1.apply$mcV$sp(Play.scala:88) at play.api.Play$$anonfun$start$1.apply(Play.scala:88) at play.api.Play$$anonfun$start$1.apply(Play.scala:88) at play.utils.Threads$.withContextClassLoader(Threads.scala:18) at play.api.Play$.start(Play.scala:87) at play.core.StaticApplication.(ApplicationProvider.scala:52) at play.core.server.NettyServer$.createServer(NettyServer.scala:243) at play.core.server.NettyServer$$anonfun$main$3.apply(NettyServer.scala:279) at play.core.server.NettyServer$$anonfun$main$3.apply(NettyServer.scala:274) at scala.Option.map(Option.scala:145) at play.core.server.NettyServer$.main(NettyServer.scala:274) at play.core.server.NettyServer.main(NettyServer.scala) ... less logs/application.log ... from com.jolbox.bonecp.ConnectionHandle in main Database access problem. Killing off this connection and all remaining connections in the connection pool. SQL State = HY000 ...

hereTac commented 7 years ago

i have solve this problem . it is caused by mysql . not belong dr-elephant . solve the mysql , make sure u can access mysql .

andrijaperovic commented 6 years ago

@zhangxin0112 what do you mean mysql does not belong to dr-elephant? Is there a dr-elephant user which has to own a specific config directory? I am also seeing SQL State = HY000.

Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=256m; support was removed in 8.0
Java HotSpot(TM) 64-Bit Server VM warning: Cannot open file /apps/dr-elephant-dist/dr-elephant-2.0.13/bin/../../logs/elephant/dr-gc.201802201645 due to No such file or directory

Play server process ID is 27011
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/apps/dr-elephant-dist/dr-elephant-2.0.13/lib/ch.qos.logback.logback-classic-1.0.13.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/apps/dr-elephant-dist/dr-elephant-2.0.13/lib/org.slf4j.slf4j-simple-1.6.6.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/apps/dr-elephant-dist/dr-elephant-2.0.13/lib/org.slf4j.slf4j-log4j12-1.7.10.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/opt/cloudera/parcels/CDH-5.11.0-1.cdh5.11.0.p0.34/jars/slf4j-log4j12-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [ch.qos.logback.classic.util.ContextSelectorStaticBinder]
[info] play - database [default] connected at jdbc:mysql://localhost/drelephant?characterEncoding=UTF-8
[error] c.j.b.ConnectionHandle - Database access problem. Killing off this connection and all remaining connections in the connection pool. SQL State = HY000
Oops, cannot start the server.
java.sql.SQLException: Connection is closed!
    at com.jolbox.bonecp.ConnectionHandle.checkClosed(ConnectionHandle.java:459)
    at com.jolbox.bonecp.ConnectionHandle.prepareStatement(ConnectionHandle.java:1011)
    at play.api.db.evolutions.Evolutions$.prepare(Evolutions.scala:125)
    at play.api.db.evolutions.Evolutions$.updateLastProblem$1(Evolutions.scala:244)
    at play.api.db.evolutions.Evolutions$.applyScript(Evolutions.scala:271)
    at play.api.db.evolutions.EvolutionsPlugin$$anonfun$onStart$1$$anonfun$apply$1.apply$mcV$sp(Evolutions.scala:472)
    at play.api.db.evolutions.EvolutionsPlugin.withLock(Evolutions.scala:507)
    at play.api.db.evolutions.EvolutionsPlugin$$anonfun$onStart$1.apply(Evolutions.scala:461)
    at play.api.db.evolutions.EvolutionsPlugin$$anonfun$onStart$1.apply(Evolutions.scala:459)
    at scala.collection.immutable.List.foreach(List.scala:318)
    at play.api.db.evolutions.EvolutionsPlugin.onStart(Evolutions.scala:459)
    at play.api.Play$$anonfun$start$1$$anonfun$apply$mcV$sp$1.apply(Play.scala:88)
    at play.api.Play$$anonfun$start$1$$anonfun$apply$mcV$sp$1.apply(Play.scala:88)
    at scala.collection.immutable.List.foreach(List.scala:318)
    at play.api.Play$$anonfun$start$1.apply$mcV$sp(Play.scala:88)
    at play.api.Play$$anonfun$start$1.apply(Play.scala:88)
    at play.api.Play$$anonfun$start$1.apply(Play.scala:88)
    at play.utils.Threads$.withContextClassLoader(Threads.scala:18)
    at play.api.Play$.start(Play.scala:87)
    at play.core.StaticApplication.<init>(ApplicationProvider.scala:52)
    at play.core.server.NettyServer$.createServer(NettyServer.scala:243)
    at play.core.server.NettyServer$$anonfun$main$3.apply(NettyServer.scala:279)
    at play.core.server.NettyServer$$anonfun$main$3.apply(NettyServer.scala:274)
    at scala.Option.map(Option.scala:145)
    at play.core.server.NettyServer$.main(NettyServer.scala:274)
    at play.core.server.NettyServer.main(NettyServer.scala)

andrijaperovic commented 6 years ago

Output on /var/log/mysql.log after enabling general_log on /etc/my.conf:

180220 17:23:42    10 Connect   root@localhost on drelephant
           10 Query /* mysql-connector-java-5.1.36 ( Revision: 4fc1f969f740409a4e03750316df2c0e429f3dc8 ) */SELECT @@session.auto_increment_increment, @@character_set_client, @@character_set_connection, @@character_set_results, @@character_set_server, @@init_connect, @@interactive_timeout, @@language, @@license, @@lower_case_table_names, @@max_allowed_packet, @@net_buffer_length, @@net_write_timeout, @@query_cache_size, @@query_cache_type, @@sql_mode, @@system_time_zone, @@time_zone, @@tx_isolation, @@wait_timeout
           10 Query SET character_set_results = NULL
           10 Query SET autocommit=1
           10 Query SET sql_mode='STRICT_TRANS_TABLES'
           10 Quit
           11 Connect   root@localhost on drelephant
           11 Query /* mysql-connector-java-5.1.36 ( Revision: 4fc1f969f740409a4e03750316df2c0e429f3dc8 ) */SELECT @@session.auto_increment_increment, @@character_set_client, @@character_set_connection, @@character_set_results, @@character_set_server, @@init_connect, @@interactive_timeout, @@language, @@license, @@lower_case_table_names, @@max_allowed_packet, @@net_buffer_length, @@net_write_timeout, @@query_cache_size, @@query_cache_type, @@sql_mode, @@system_time_zone, @@time_zone, @@tx_isolation, @@wait_timeout
           11 Query SET character_set_results = NULL
           11 Query SET autocommit=1
           11 Query SET sql_mode='STRICT_TRANS_TABLES'
           11 Quit
           12 Connect   root@localhost on drelephant
           12 Query /* mysql-connector-java-5.1.36 ( Revision: 4fc1f969f740409a4e03750316df2c0e429f3dc8 ) */SELECT @@session.auto_increment_increment, @@character_set_client, @@character_set_connection, @@character_set_results, @@character_set_server, @@init_connect, @@interactive_timeout, @@language, @@license, @@lower_case_table_names, @@max_allowed_packet, @@net_buffer_length, @@net_write_timeout, @@query_cache_size, @@query_cache_type, @@sql_mode, @@system_time_zone, @@time_zone, @@tx_isolation, @@wait_timeout
           12 Query SET character_set_results = NULL
           12 Query SET autocommit=1
           12 Query SET sql_mode='STRICT_TRANS_TABLES'
           12 Query SET autocommit=1
           13 Connect   root@localhost on drelephant
           13 Query /* mysql-connector-java-5.1.36 ( Revision: 4fc1f969f740409a4e03750316df2c0e429f3dc8 ) */SELECT @@session.auto_increment_increment, @@character_set_client, @@character_set_connection, @@character_set_results, @@character_set_server, @@init_connect, @@interactive_timeout, @@language, @@license, @@lower_case_table_names, @@max_allowed_packet, @@net_buffer_length, @@net_write_timeout, @@query_cache_size, @@query_cache_type, @@sql_mode, @@system_time_zone, @@time_zone, @@tx_isolation, @@wait_timeout
           13 Query SET character_set_results = NULL
           13 Query SET autocommit=1
           13 Query SET sql_mode='STRICT_TRANS_TABLES'
           13 Query SET autocommit=1
           14 Connect   root@localhost on drelephant
           14 Query /* mysql-connector-java-5.1.36 ( Revision: 4fc1f969f740409a4e03750316df2c0e429f3dc8 ) */SELECT @@session.auto_increment_increment, @@character_set_client, @@character_set_connection, @@character_set_results, @@character_set_server, @@init_connect, @@interactive_timeout, @@language, @@license, @@lower_case_table_names, @@max_allowed_packet, @@net_buffer_length, @@net_write_timeout, @@query_cache_size, @@query_cache_type, @@sql_mode, @@system_time_zone, @@time_zone, @@tx_isolation, @@wait_timeout
           14 Query SET character_set_results = NULL
           14 Query SET autocommit=1
           14 Query SET sql_mode='STRICT_TRANS_TABLES'
           14 Query SET autocommit=1
           15 Connect   root@localhost on drelephant
           15 Query /* mysql-connector-java-5.1.36 ( Revision: 4fc1f969f740409a4e03750316df2c0e429f3dc8 ) */SELECT @@session.auto_increment_increment, @@character_set_client, @@character_set_connection, @@character_set_results, @@character_set_server, @@init_connect, @@interactive_timeout, @@language, @@license, @@lower_case_table_names, @@max_allowed_packet, @@net_buffer_length, @@net_write_timeout, @@query_cache_size, @@query_cache_type, @@sql_mode, @@system_time_zone, @@time_zone, @@tx_isolation, @@wait_timeout
           15 Query SET character_set_results = NULL
           15 Query SET autocommit=1
           15 Query SET sql_mode='STRICT_TRANS_TABLES'
           15 Query SET autocommit=1
           16 Connect   root@localhost on drelephant
           16 Query /* mysql-connector-java-5.1.36 ( Revision: 4fc1f969f740409a4e03750316df2c0e429f3dc8 ) */SELECT @@session.auto_increment_increment, @@character_set_client, @@character_set_connection, @@character_set_results, @@character_set_server, @@init_connect, @@interactive_timeout, @@language, @@license, @@lower_case_table_names, @@max_allowed_packet, @@net_buffer_length, @@net_write_timeout, @@query_cache_size, @@query_cache_type, @@sql_mode, @@system_time_zone, @@time_zone, @@tx_isolation, @@wait_timeout
           16 Query SET character_set_results = NULL
           16 Query SET autocommit=1
           16 Query SET sql_mode='STRICT_TRANS_TABLES'
           16 Query SET autocommit=1
           12 Query SET autocommit=1
           12 Query SET autocommit=1
           13 Query SET autocommit=1
           13 Query SET autocommit=1
180220 17:23:43    14 Query SET autocommit=1
           14 Query SET autocommit=0
           14 Query rollback
           14 Query SET autocommit=1
           15 Query SET autocommit=1
           15 Query SET autocommit=0
           15 Query rollback
           15 Query SET autocommit=1
           16 Query SET autocommit=1
           16 Query SET autocommit=1
           12 Query SET autocommit=1
           12 Query SET autocommit=1
           12 Query select id, hash, apply_script, revert_script, state, last_problem from play_evolutions where state like 'applying_%'
           12 Query create table play_evolutions (
                  id int not null primary key, hash varchar(255) not null,
                  applied_at timestamp not null,
                  apply_script text,
                  revert_script text,
                  state varchar(255),
                  last_problem text
              )
           12 Query SET autocommit=1
           16 Query select id, hash, apply_script, revert_script from play_evolutions order by id
           16 Query SET autocommit=1
           13 Query SET autocommit=1
           13 Query SET autocommit=1
           14 Query SET autocommit=1
           14 Query SET autocommit=1
           14 Query select id, hash, apply_script, revert_script, state, last_problem from play_evolutions where state like 'applying_%'
           14 Query SET autocommit=1
           13 Query insert into play_evolutions values(1, 'b2fc1464cd3a45a4bb0d3dbd70d41f01e3c8e917', '2018-02-20', 'CREATE TABLE yarn_app_result (\nid               VARCHAR(50)   NOT NULL              COMMENT \'The application id, e.g., application_1236543456321_1234567\',\nname             VARCHAR(100)  NOT NULL              COMMENT \'The application name\',\nusername         VARCHAR(50)   NOT NULL              COMMENT \'The user who started the application\',\nqueue_name       VARCHAR(50)   DEFAULT NULL          COMMENT \'The queue the application was submitted to\',\nstart_time       BIGINT        UNSIGNED NOT NULL     COMMENT \'The time in which application started\',\nfinish_time      BIGINT        UNSIGNED NOT NULL     COMMENT \'The time in which application finished\',\ntracking_url     VARCHAR(255)  NOT NULL              COMMENT \'The web URL that can be used to track the application\',\njob_type         VARCHAR(20)   NOT NULL              COMMENT \'The Job Type e.g, Pig, Hive, Spark, HadoopJava\',\nseverity         TINYINT(2)    UNSIGNED NOT NULL     COMMENT \'Aggregate severity of all the heuristics. Ranges from 0(LOW) to 4(CRITICAL)\',\nscore            MEDIUMINT(9)  UNSIGNED DEFAULT 0    COMMENT \'The application score which is the sum of heuristic scores\',\nworkflow_depth   TINYINT(2)    UNSIGNED DEFAULT 0    COMMENT \'The application depth in the scheduled flow. Depth starts from 0\',\nscheduler        VARCHAR(20)   DEFAULT NULL          COMMENT \'The scheduler which triggered the application\',\njob_name         VARCHAR(255)  NOT NULL DEFAULT \'\'   COMMENT \'The name of the job in the flow to which this app belongs\',\njob_exec_id      VARCHAR(800)  NOT NULL DEFAULT \'\'   COMMENT \'A unique reference to a specific execution of the job/action(job in the workflow). This should filter all applications (mapreduce/spark) triggered by the job for a particular execution.\',\nflow_exec_id     VARCHAR(255)  NOT NULL DEFAULT \'\'   COMMENT \'A unique reference to a specific flow execution. This should filter all applications fired by a particular flow execution. Note that if the scheduler supports sub-workflows, then this ID should be the super parent flow execution id that triggered the the applications and sub-workflows.\',\njob_def_id       VARCHAR(800)  NOT NULL DEFAULT \'\'   COMMENT \'A unique reference to the job in the entire flow independent of the execution. This should filter all the applications(mapreduce/spark) triggered by the job for all the historic executions of that job.\',\nflow_def_id      VARCHAR(800)  NOT NULL DEFAULT \'\'   COMMENT \'A unique reference to the entire flow independent of any execution. This should filter all the historic mr jobs belonging to the flow. Note that if your scheduler supports sub-workflows, then this ID should reference the super parent flow that triggered the all the jobs and sub-workflows.\',\njob_exec_url     VARCHAR(800)  NOT NULL DEFAULT \'\'   COMMENT \'A url to the job execution on the scheduler\',\nflow_exec_url    VARCHAR(800)  NOT NULL DEFAULT \'\'   COMMENT \'A url to the flow execution on the scheduler\',\njob_def_url      VARCHAR(800)  NOT NULL DEFAULT \'\'   COMMENT \'A url to the job definition on the scheduler\',\nflow_def_url     VARCHAR(800)  NOT NULL DEFAULT \'\'   COMMENT \'A url to the flow definition on the scheduler\',\n\nPRIMARY KEY (id)\n);\n\ncreate index yarn_app_result_i1 on yarn_app_result (finish_time);\ncreate index yarn_app_result_i2 on yarn_app_result (username,finish_time);\ncreate index yarn_app_result_i3 on yarn_app_result (job_type,username,finish_time);\ncreate index yarn_app_result_i4 on yarn_app_result (flow_exec_id);\ncreate index yarn_app_result_i5 on yarn_app_result (job_def_id);\ncreate index yarn_app_result_i6 on yarn_app_result (flow_def_id);\ncreate index yarn_app_result_i7 on yarn_app_result (start_time);\n\nCREATE TABLE yarn_app_heuristic_result (\nid                  INT(11)       NOT NULL AUTO_INCREMENT COMMENT \'The application heuristic result id\',\nyarn_app_result_id  VARCHAR(50)   NOT NULL                COMMENT \'The application id\',\nheuristic_class     VARCHAR(255)  NOT NULL                COMMENT \'Name of the JVM class that implements this heuristic\',\nheuristic_name      VARCHAR(128)  NOT NULL                COMMENT \'The heuristic name\',\nseverity            TINYINT(2)    UNSIGNED NOT NULL       COMMENT \'The heuristic severity ranging from 0(LOW) to 4(CRITICAL)\',\nscore               MEDIUMINT(9)  UNSIGNED DEFAULT 0      COMMENT \'The heuristic score for the application. score = severity * number_of_tasks(map/reduce) where severity not in [0,1], otherwise score = 0\',\n\nPRIMARY KEY (id),\nCONSTRAINT yarn_app_heuristic_result_f1 FOREIGN KEY (yarn_app_result_id) REFERENCES yarn_app_result (id)\n);\n\ncreate index yarn_app_heuristic_result_i1 on yarn_app_heuristic_result (yarn_app_result_id);\ncreate index yarn_app_heuristic_result_i2 on yarn_app_heuristic_result (heuristic_name,severity);\n\nCREATE TABLE yarn_app_heuristic_result_details (\nyarn_app_heuristic_result_id  INT(11) NOT NULL                  COMMENT \'The application heuristic result id\',\nname                          VARCHAR(128) NOT NULL DEFAULT \'\'  COMMENT \'The analysis detail entry name/key\',\nvalue                         VARCHAR(255) NOT NULL DEFAULT \'\'  COMMENT \'The analysis detail value corresponding to the name\',\ndetails                       TEXT                              COMMENT \'More information on analysis details. e.g, stacktrace\',\n\nPRIMARY KEY (yarn_app_heuristic_result_id,name),\nCONSTRAINT yarn_app_heuristic_result_details_f1 FOREIGN KEY (yarn_app_heuristic_result_id) REFERENCES yarn_app_heuristic_result (id)\n);\n\ncreate index yarn_app_heuristic_result_details_i1 on yarn_app_heuristic_result_details (name);', 'SET FOREIGN_KEY_CHECKS=0;\n\nDROP TABLE yarn_app_result;\n\nDROP TABLE yarn_app_heuristic_result;\n\nDROP TABLE yarn_app_heuristic_result_details;\n\nSET FOREIGN_KEY_CHECKS=1;\n\n# --- Created by Ebean DDL\n# To stop Ebean DDL generation, remove this comment and start using Evolutions', 'applying_up', '')
           13 Query CREATE TABLE yarn_app_result (
id               VARCHAR(50)   NOT NULL              COMMENT 'The application id, e.g., application_1236543456321_1234567',
name             VARCHAR(100)  NOT NULL              COMMENT 'The application name',
username         VARCHAR(50)   NOT NULL              COMMENT 'The user who started the application',
queue_name       VARCHAR(50)   DEFAULT NULL          COMMENT 'The queue the application was submitted to',
start_time       BIGINT        UNSIGNED NOT NULL     COMMENT 'The time in which application started',
finish_time      BIGINT        UNSIGNED NOT NULL     COMMENT 'The time in which application finished',
tracking_url     VARCHAR(255)  NOT NULL              COMMENT 'The web URL that can be used to track the application',
job_type         VARCHAR(20)   NOT NULL              COMMENT 'The Job Type e.g, Pig, Hive, Spark, HadoopJava',
severity         TINYINT(2)    UNSIGNED NOT NULL     COMMENT 'Aggregate severity of all the heuristics. Ranges from 0(LOW) to 4(CRITICAL)',
score            MEDIUMINT(9)  UNSIGNED DEFAULT 0    COMMENT 'The application score which is the sum of heuristic scores',
workflow_depth   TINYINT(2)    UNSIGNED DEFAULT 0    COMMENT 'The application depth in the scheduled flow. Depth starts from 0',
scheduler        VARCHAR(20)   DEFAULT NULL          COMMENT 'The scheduler which triggered the application',
job_name         VARCHAR(255)  NOT NULL DEFAULT ''   COMMENT 'The name of the job in the flow to which this app belongs',
job_exec_id      VARCHAR(800)  NOT NULL DEFAULT ''   COMMENT 'A unique reference to a specific execution of the job/action(job in the workflow). This should filter all applications (mapreduce/spark) triggered by the job for a particular execution.',
flow_exec_id     VARCHAR(255)  NOT NULL DEFAULT ''   COMMENT 'A unique reference to a specific flow execution. This should filter all applications fired by a particular flow execution. Note that if the scheduler supports sub-workflows, then this ID should be the super parent flow execution id that triggered the the applications and sub-workflows.',
job_def_id       VARCHAR(800)  NOT NULL DEFAULT ''   COMMENT 'A unique reference to the job in the entire flow independent of the execution. This should filter all the applications(mapreduce/spark) triggered by the job for all the historic executions of that job.',
flow_def_id      VARCHAR(800)  NOT NULL DEFAULT ''   COMMENT 'A unique reference to the entire flow independent of any execution. This should filter all the historic mr jobs belonging to the flow. Note that if your scheduler supports sub-workflows, then this ID should reference the super parent flow that triggered the all the jobs and sub-workflows.',
job_exec_url     VARCHAR(800)  NOT NULL DEFAULT ''   COMMENT 'A url to the job execution on the scheduler',
flow_exec_url    VARCHAR(800)  NOT NULL DEFAULT ''   COMMENT 'A url to the flow execution on the scheduler',
job_def_url      VARCHAR(800)  NOT NULL DEFAULT ''   COMMENT 'A url to the job definition on the scheduler',
flow_def_url     VARCHAR(800)  NOT NULL DEFAULT ''   COMMENT 'A url to the flow definition on the scheduler',

PRIMARY KEY (id)
)
           15 Quit
           12 Quit
           16 Quit
           14 Quit
           13 Quit
           17 Connect   root@localhost on drelephant
           17 Query /* mysql-connector-java-5.1.36 ( Revision: 4fc1f969f740409a4e03750316df2c0e429f3dc8 ) */SELECT @@session.auto_increment_increment, @@character_set_client, @@character_set_connection, @@character_set_results, @@character_set_server, @@init_connect, @@interactive_timeout, @@language, @@license, @@lower_case_table_names, @@max_allowed_packet, @@net_buffer_length, @@net_write_timeout, @@query_cache_size, @@query_cache_type, @@sql_mode, @@system_time_zone, @@time_zone, @@tx_isolation, @@wait_timeout
           17 Query SET character_set_results = NULL
           17 Query SET autocommit=1
           17 Query SET sql_mode='STRICT_TRANS_TABLES'
           17 Query SET autocommit=1

andrijaperovic commented 6 years ago

There is a play_evolutions table in drelephant database. These are the entries which are there (raw sql commands stored in plaintext).

mysql> select * from play_evolutions;
+----+------------------------------------------+---------------------+------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+-------------+--------------+
| id | hash                                     | applied_at          | apply_script                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                     | revert_script                                                                                                                                                                                                                                                                      | state       | last_problem |
+----+------------------------------------------+---------------------+------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+-------------+--------------+
|  1 | b2fc1464cd3a45a4bb0d3dbd70d41f01e3c8e917 | 2018-02-20 00:00:00 | CREATE TABLE yarn_app_result (
id               VARCHAR(50)   NOT NULL              COMMENT 'The application id, e.g., application_1236543456321_1234567',
name             VARCHAR(100)  NOT NULL              COMMENT 'The application name',
username         VARCHAR(50)   NOT NULL              COMMENT 'The user who started the application',
queue_name       VARCHAR(50)   DEFAULT NULL          COMMENT 'The queue the application was submitted to',
start_time       BIGINT        UNSIGNED NOT NULL     COMMENT 'The time in which application started',
finish_time      BIGINT        UNSIGNED NOT NULL     COMMENT 'The time in which application finished',
tracking_url     VARCHAR(255)  NOT NULL              COMMENT 'The web URL that can be used to track the application',
job_type         VARCHAR(20)   NOT NULL              COMMENT 'The Job Type e.g, Pig, Hive, Spark, HadoopJava',
severity         TINYINT(2)    UNSIGNED NOT NULL     COMMENT 'Aggregate severity of all the heuristics. Ranges from 0(LOW) to 4(CRITICAL)',
score            MEDIUMINT(9)  UNSIGNED DEFAULT 0    COMMENT 'The application score which is the sum of heuristic scores',
workflow_depth   TINYINT(2)    UNSIGNED DEFAULT 0    COMMENT 'The application depth in the scheduled flow. Depth starts from 0',
scheduler        VARCHAR(20)   DEFAULT NULL          COMMENT 'The scheduler which triggered the application',
job_name         VARCHAR(255)  NOT NULL DEFAULT ''   COMMENT 'The name of the job in the flow to which this app belongs',
job_exec_id      VARCHAR(800)  NOT NULL DEFAULT ''   COMMENT 'A unique reference to a specific execution of the job/action(job in the workflow). This should filter all applications (mapreduce/spark) triggered by the job for a particular execution.',
flow_exec_id     VARCHAR(255)  NOT NULL DEFAULT ''   COMMENT 'A unique reference to a specific flow execution. This should filter all applications fired by a particular flow execution. Note that if the scheduler supports sub-workflows, then this ID should be the super parent flow execution id that triggered the the applications and sub-workflows.',
job_def_id       VARCHAR(800)  NOT NULL DEFAULT ''   COMMENT 'A unique reference to the job in the entire flow independent of the execution. This should filter all the applications(mapreduce/spark) triggered by the job for all the historic executions of that job.',
flow_def_id      VARCHAR(800)  NOT NULL DEFAULT ''   COMMENT 'A unique reference to the entire flow independent of any execution. This should filter all the historic mr jobs belonging to the flow. Note that if your scheduler supports sub-workflows, then this ID should reference the super parent flow that triggered the all the jobs and sub-workflows.',
job_exec_url     VARCHAR(800)  NOT NULL DEFAULT ''   COMMENT 'A url to the job execution on the scheduler',
flow_exec_url    VARCHAR(800)  NOT NULL DEFAULT ''   COMMENT 'A url to the flow execution on the scheduler',
job_def_url      VARCHAR(800)  NOT NULL DEFAULT ''   COMMENT 'A url to the job definition on the scheduler',
flow_def_url     VARCHAR(800)  NOT NULL DEFAULT ''   COMMENT 'A url to the flow definition on the scheduler',

PRIMARY KEY (id)
);

create index yarn_app_result_i1 on yarn_app_result (finish_time);
create index yarn_app_result_i2 on yarn_app_result (username,finish_time);
create index yarn_app_result_i3 on yarn_app_result (job_type,username,finish_time);
create index yarn_app_result_i4 on yarn_app_result (flow_exec_id);
create index yarn_app_result_i5 on yarn_app_result (job_def_id);
create index yarn_app_result_i6 on yarn_app_result (flow_def_id);
create index yarn_app_result_i7 on yarn_app_result (start_time);

CREATE TABLE yarn_app_heuristic_result (
id                  INT(11)       NOT NULL AUTO_INCREMENT COMMENT 'The application heuristic result id',
yarn_app_result_id  VARCHAR(50)   NOT NULL                COMMENT 'The application id',
heuristic_class     VARCHAR(255)  NOT NULL                COMMENT 'Name of the JVM class that implements this heuristic',
heuristic_name      VARCHAR(128)  NOT NULL                COMMENT 'The heuristic name',
severity            TINYINT(2)    UNSIGNED NOT NULL       COMMENT 'The heuristic severity ranging from 0(LOW) to 4(CRITICAL)',
score               MEDIUMINT(9)  UNSIGNED DEFAULT 0      COMMENT 'The heuristic score for the application. score = severity * number_of_tasks(map/reduce) where severity not in [0,1], otherwise score = 0',

PRIMARY KEY (id),
CONSTRAINT yarn_app_heuristic_result_f1 FOREIGN KEY (yarn_app_result_id) REFERENCES yarn_app_result (id)
);

create index yarn_app_heuristic_result_i1 on yarn_app_heuristic_result (yarn_app_result_id);
create index yarn_app_heuristic_result_i2 on yarn_app_heuristic_result (heuristic_name,severity);

CREATE TABLE yarn_app_heuristic_result_details (
yarn_app_heuristic_result_id  INT(11) NOT NULL                  COMMENT 'The application heuristic result id',
name                          VARCHAR(128) NOT NULL DEFAULT ''  COMMENT 'The analysis detail entry name/key',
value                         VARCHAR(255) NOT NULL DEFAULT ''  COMMENT 'The analysis detail value corresponding to the name',
details                       TEXT                              COMMENT 'More information on analysis details. e.g, stacktrace',

PRIMARY KEY (yarn_app_heuristic_result_id,name),
CONSTRAINT yarn_app_heuristic_result_details_f1 FOREIGN KEY (yarn_app_heuristic_result_id) REFERENCES yarn_app_heuristic_result (id)
);

create index yarn_app_heuristic_result_details_i1 on yarn_app_heuristic_result_details (name); | SET FOREIGN_KEY_CHECKS=0;

DROP TABLE yarn_app_result;

DROP TABLE yarn_app_heuristic_result;

DROP TABLE yarn_app_heuristic_result_details;

SET FOREIGN_KEY_CHECKS=1;

# --- Created by Ebean DDL
# To stop Ebean DDL generation, remove this comment and start using Evolutions | applying_up |              |
+----+------------------------------------------+---------------------+------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+-------------+--------------+
1 row in set (0.00 sec)

loupipalien commented 6 years ago

@andrijaperovic I also met this problem, but i find bonecp/pull#20 when i was tracing playframework/issues#1973 , so packaging bonecp-0.8.1-SNAPSHOT.jar to replace com.jolbox.bonecp-0.8.0.RELEASE.jar, but throws other errors:

Database use MariaDB-5.5.44 [error] play - Incorrect table definition; there can be only one TIMESTAMP column with CURRENT_TIMESTAMP in DEFAULT or ON UPDATE clause [ERROR:1293, SQLSTATE:HY000]
Database use Mysql-5.6.35-log [error] play - Specified key was too long; max key length is 767 bytes [ERROR:1071, SQLSTATE:42000]

there are tow questions on stackoverflow that describle the errors that i met: why-there-can-be-only-one-timestamp-column-with-current-timestamp-in-default-cla and 1071-specified-key-was-too-long-max-key-length-is-767-bytes
dr-elephant start successfully when i upgrade mysql to 5.7, even don't need to replace com.jolbox.bonecp-0.8.0.RELEASE.jar

linkedin / dr-elephant

first start elephant with the error and exit #230