search

datahub-project / datahub

The Metadata Platform for your Data Stack
https://datahubproject.io
Apache License 2.0
9.86k stars 2.92k forks source link

datahub-gms is not running #3023

Closed frankShih closed 3 years ago

frankShih commented 3 years ago

Describe the bug Unable to run quickstart - the following issues were detected:

To Reproduce Run the 'quickstart' command

Expected behavior Service starts successfully

Desktop (please complete the following information):

Additional context The detail of the log file: tmp.log

And the status of containers image

The services below did not start successfully

Any suggestion would be appreciated.

thomasroshin commented 3 years ago

I am facing the same issue I think the log in the file is too huge, lots of messages like :

80-war_war-_-any-8887165006427440178.dir/webapp/WEB-INF/lib/netty-all-4.1.44.Final.jar!/io/netty/util/internal/svm/UnsafeRefArrayAccessSubstitution.class
^[[32mdatahub-gms               |^[[0m 2021/08/05 10:19:37 Command exited with error: signal: killed
^[[32mdatahub-gms               |^[[0m sh: true: unknown operand
^[[32mdatahub-gms               |^[[0m 2021/08/05 10:19:59 Waiting for: tcp://mysql:3306
^[[32mdatahub-gms               |^[[0m 2021/08/05 10:19:59 Waiting for: tcp://broker:29092
^[[32mdatahub-gms               |^[[0m 2021/08/05 10:19:59 Waiting for: http://elasticsearch:9200
^[[32mdatahub-gms               |^[[0m 2021/08/05 10:19:59 Connected to tcp://broker:29092
^[[32mdatahub-gms               |^[[0m 2021/08/05 10:19:59 Connected to tcp://mysql:3306
^[[32mdatahub-gms               |^[[0m 2021/08/05 10:19:59 Received 200 from http://elasticsearch:9200
^[[32mdatahub-gms               |^[[0m 2021-08-05 10:19:59.826:INFO::main: Logging initialized @353ms to org.eclipse.jetty.util.log.StdErrLog
docker ps -a 

CONTAINER ID   IMAGE                                       COMMAND                  CREATED          STATUS                        PORTS                                                                                      NAMES
9354ca9b51cd   linkedin/datahub-kafka-setup:head           "/bin/sh -c ./kafka-…"   46 minutes ago   Exited (0) 20 minutes ago                                                                                                kafka-setup
613810c6d411   confluentinc/cp-schema-registry:5.4.0       "/etc/confluent/dock…"   46 minutes ago   Up 46 minutes                 0.0.0.0:8081->8081/tcp, :::8081->8081/tcp                                                  schema-registry
82d3eadfc0e0   linkedin/datahub-frontend-react:head        "datahub-frontend/bi…"   46 minutes ago   Up 46 minutes (healthy)       0.0.0.0:9002->9002/tcp, :::9002->9002/tcp                                                  datahub-frontend-react
4cb34442efb2   confluentinc/cp-kafka:5.4.0                 "/etc/confluent/dock…"   46 minutes ago   Up 46 minutes                 0.0.0.0:9092->9092/tcp, :::9092->9092/tcp, 0.0.0.0:29092->29092/tcp, :::29092->29092/tcp   broker
61766d281442   linkedin/datahub-elasticsearch-setup:head   "dockerize /bin/sh -…"   46 minutes ago   Exited (0) 21 minutes ago                                                                                                elasticsearch-setup
777d0b484d7e   linkedin/datahub-gms:head                   "/bin/sh -c /datahub…"   46 minutes ago   Exited (255) 21 minutes ago                                                                                              datahub-gms
c05cd4cda067   acryldata/datahub-mysql-setup:head          "dockerize /bin/sh -…"   46 minutes ago   Exited (0) 21 minutes ago                                                                                                mysql-setup
f9c0ddebf966   mysql:5.7                                   "docker-entrypoint.s…"   46 minutes ago   Up 45 minutes                 0.0.0.0:3306->3306/tcp, :::3306->3306/tcp, 33060/tcp                                       mysql
4eaf289bf636   elasticsearch:7.9.3                         "/tini -- /usr/local…"   46 minutes ago   Up 46 minutes (healthy)       0.0.0.0:9200->9200/tcp, :::9200->9200/tcp, 9300/tcp                                        elasticsearch
05300df4ba31   confluentinc/cp-zookeeper:5.4.0             "/etc/confluent/dock…"   46 minutes ago   Up 46 minutes                 2888/tcp, 0.0.0.0:2181->2181/tcp, :::2181->2181/tcp, 3888/tcp

Details

$ datahub version DataHub CLI version: 0.8.8.0 Python version: 3.6.8 (default, Nov 16 2020, 16:55:22) [GCC 4.8.5 20150623 (Red Hat 4.8.5-44)]

$ datahub docker quickstart
Fetching docker-compose file from GitHub
No Datahub Neo4j volume found, starting with elasticsearch as graph service.
To use neo4j as a graph backend, run
`datahub docker quickstart --quickstart-compose-file ./docker/quickstart/docker-compose.quickstart.yml`
from the root of the datahub repo

Pulling elasticsearch          ... done
Pulling elasticsearch-setup    ... done
Pulling mysql                  ... done
Pulling datahub-gms            ... done
Pulling datahub-frontend-react ... done
Pulling mysql-setup            ... done
Pulling zookeeper              ... done
Pulling broker                 ... done
Pulling schema-registry        ... done
Pulling kafka-setup            ... done

Creating network "datahub_network" with the default driver
Creating volume "datahub_esdata" with default driver
Creating volume "datahub_mysqldata" with default driver
Creating volume "datahub_zkdata" with default driver
Creating zookeeper           ... done
Creating mysql         ... done
Creating elasticsearch ... done
Creating datahub-gms         ... done
Creating mysql-setup         ... done
Creating elasticsearch-setup ... done
Creating broker                 ... done
Creating datahub-frontend-react ... done
Creating schema-registry        ... done
Creating kafka-setup            ... done
.....
zookeeper is up-to-date
mysql is up-to-date
elasticsearch is up-to-date
broker is up-to-date
mysql-setup is up-to-date
datahub-gms is up-to-date
elasticsearch-setup is up-to-date
schema-registry is up-to-date
datahub-frontend-react is up-to-date
kafka-setup is up-to-date
..............

:
...........
mysql is up-to-date
zookeeper is up-to-date
elasticsearch is up-to-date
Starting mysql-setup ...
broker is up-to-date
Starting mysql-setup         ... done
Starting datahub-gms         ... done
Starting elasticsearch-setup ... done
Starting kafka-setup         ... done
datahub-frontend-react is up-to-date
.............
Unable to run quickstart - the following issues were detected:
- datahub-gms is not running

If you think something went wrong, please file an issue at https://github.com/linkedin/datahub/issues
or send a message in our Slack https://slack.datahubproject.io/
Be sure to attach the logs from /tmp/tmpjki_e9g7.log

Any pointers would be helpful.

regards

frankShih commented 3 years ago

I try to extract all "error" terms in the log file and here is the result:

broker                    | [main-SendThread(zookeeper:2181)] INFO org.apache.zookeeper.ClientCnxn - Opening socket connection to server zookeeper/172.21.0.2:2181. Will not attempt to authenticate using SASL (unknown error)
broker                    | [2021-08-06 00:58:50,319] TRACE [Controller id=1 epoch=1] Received response {error_code=0,_tagged_fields={}} for request UPDATE_METADATA with correlation id 0 sent to broker broker:29092 (id: 1 rack: null) (state.change.logger)
broker                    | [2021-08-06 00:58:51,994] TRACE [Controller id=1 epoch=1] Received response {error_code=0,partition_errors=[{topic_name=__confluent.support.metrics,partition_index=0,error_code=0,_tagged_fields={}}],_tagged_fields={}} for request LEADER_AND_ISR with correlation id 1 sent to broker broker:29092 (id: 1 rack: null) (state.change.logger)
broker                    | [2021-08-06 00:58:54,992] TRACE [Controller id=1 epoch=1] Received response {error_code=0,partition_errors=[{topic_name=MetadataAuditEvent_v4,partition_index=0,error_code=0,_tagged_fields={}}],_tagged_fields={}} for request LEADER_AND_ISR with correlation id 3 sent to broker broker:29092 (id: 1 rack: null) (state.change.logger)
broker                    | [2021-08-06 00:58:57,525] TRACE [Controller id=1 epoch=1] Received response {error_code=0,partition_errors=[{topic_name=_schemas,partition_index=0,error_code=0,_tagged_fields={}}],_tagged_fields={}} for request LEADER_AND_ISR with correlation id 5 sent to broker broker:29092 (id: 1 rack: null) (state.change.logger)
broker                    | [2021-08-06 00:58:59,777] TRACE [Controller id=1 epoch=1] Received response {error_code=0,partition_errors=[{topic_name=MetadataChangeEvent_v4,partition_index=0,error_code=0,_tagged_fields={}}],_tagged_fields={}} for request LEADER_AND_ISR with correlation id 7 sent to broker broker:29092 (id: 1 rack: null) (state.change.logger)
broker                    | [2021-08-06 00:59:04,305] TRACE [Controller id=1 epoch=1] Received response {error_code=0,partition_errors=[{topic_name=FailedMetadataChangeEvent_v4,partition_index=0,error_code=0,_tagged_fields={}}],_tagged_fields={}} for request LEADER_AND_ISR with correlation id 9 sent to broker broker:29092 (id: 1 rack: null) (state.change.logger)
broker                    | [2021-08-06 00:59:07,205] TRACE [Controller id=1 epoch=1] Received response {error_code=0,partition_errors=[{topic_name=MetadataChangeLog_Versioned_v1,partition_index=0,error_code=0,_tagged_fields={}}],_tagged_fields={}} for request LEADER_AND_ISR with correlation id 11 sent to broker broker:29092 (id: 1 rack: null) (state.change.logger)
broker                    | [2021-08-06 00:59:11,122] TRACE [Controller id=1 epoch=1] Received response {error_code=0,partition_errors=[{topic_name=MetadataChangeLog_Timeseries_v1,partition_index=0,error_code=0,_tagged_fields={}}],_tagged_fields={}} for request LEADER_AND_ISR with correlation id 13 sent to broker broker:29092 (id: 1 rack: null) (state.change.logger)
mysql                     | 2021-08-06T01:04:05.033251Z 32 [Note] Got an error reading communication packets
broker                    | [2021-08-06 00:59:14,843] TRACE [Controller id=1 epoch=1] Received response {error_code=0,partition_errors=[{topic_name=MetadataChangeProposal_v1,partition_index=0,error_code=0,_tagged_fields={}}],_tagged_fields={}} for request LEADER_AND_ISR with correlation id 15 sent to broker broker:29092 (id: 1 rack: null) (state.change.logger)
broker                    | [2021-08-06 00:59:17,283] TRACE [Controller id=1 epoch=1] Received response {error_code=0,partition_errors=[{topic_name=FailedMetadataChangeProposal_v1,partition_index=0,error_code=0,_tagged_fields={}}],_tagged_fields={}} for request LEADER_AND_ISR with correlation id 17 sent to broker broker:29092 (id: 1 rack: null) (state.change.logger)
broker                    | [2021-08-06 00:59:19,255] TRACE [Controller id=1 epoch=1] Received response {error_code=0,partition_errors=[{topic_name=DataHubUsageEvent_v1,partition_index=0,error_code=0,_tagged_fields={}}],_tagged_fields={}} for request LEADER_AND_ISR with correlation id 19 sent to broker broker:29092 (id: 1 rack: null) (state.change.logger)
datahub-gms               | 2021/08/06 00:59:16 Command exited with error: signal: killed
schema-registry           | [2021-08-06 00:58:54,658] INFO Opening socket connection to server zookeeper/172.21.0.2:2181. Will not attempt to authenticate using SASL (unknown error) (org.apache.zookeeper.ClientCnxn)
datahub-gms               | 2021/08/06 01:04:05 Command exited with error: signal: killed
elasticsearch             | {"type": "server", "timestamp": "2021-08-06T00:58:42,269Z", "level": "INFO", "component": "o.e.n.Node", "cluster.name": "docker-cluster", "node.name": "elasticsearch", "message": "JVM arguments [-Xshare:auto, -Des.networkaddress.cache.ttl=60, -Des.networkaddress.cache.negative.ttl=10, -XX:+AlwaysPreTouch, -Xss1m, -Djava.awt.headless=true, -Dfile.encoding=UTF-8, -Djna.nosys=true, -XX:-OmitStackTraceInFastThrow, -XX:+ShowCodeDetailsInExceptionMessages, -Dio.netty.noUnsafe=true, -Dio.netty.noKeySetOptimization=true, -Dio.netty.recycler.maxCapacityPerThread=0, -Dio.netty.allocator.numDirectArenas=0, -Dlog4j.shutdownHookEnabled=false, -Dlog4j2.disable.jmx=true, -Djava.locale.providers=SPI,COMPAT, -Xms1g, -Xmx1g, -XX:+UseG1GC, -XX:G1ReservePercent=25, -XX:InitiatingHeapOccupancyPercent=30, -Djava.io.tmpdir=/tmp/elasticsearch-12180994970549603676, -XX:+HeapDumpOnOutOfMemoryError, -XX:HeapDumpPath=data, -XX:ErrorFile=logs/hs_err_pid%p.log, -Xlog:gc*,gc+age=trace,safepoint:file=logs/gc.log:utctime,pid,tags:filecount=32,filesize=64m, -Des.cgroups.hierarchy.override=/, -Xms256m, -Xmx256m, -XX:MaxDirectMemorySize=134217728, -Des.path.home=/usr/share/elasticsearch, -Des.path.conf=/usr/share/elasticsearch/config, -Des.distribution.flavor=default, -Des.distribution.type=docker, -Des.bundled_jdk=true]" }
datahub-gms               | 2021-08-06 00:59:13.051:WARN:oeja.AnnotationParser:qtp544724190-14: org.antlr.runtime.tree.CommonErrorNode scanned from multiple locations: jar:file:///tmp/jetty-0_0_0_0-8080-war_war-_-any-4913003272580466620.dir/webapp/WEB-INF/lib/antlr-runtime-3.5.2.jar!/org/antlr/runtime/tree/CommonErrorNode.class, jar:file:///tmp/jetty-0_0_0_0-8080-war_war-_-any-4913003272580466620.dir/webapp/WEB-INF/lib/antlr4-4.5.jar!/org/antlr/runtime/tree/CommonErrorNode.class
datahub-gms               | 2021-08-06 00:59:13.252:WARN:oeja.AnnotationParser:qtp544724190-14: org.antlr.v4.runtime.ANTLRErrorListener scanned from multiple locations: jar:file:///tmp/jetty-0_0_0_0-8080-war_war-_-any-4913003272580466620.dir/webapp/WEB-INF/lib/antlr4-runtime-4.7.2.jar!/org/antlr/v4/runtime/ANTLRErrorListener.class, jar:file:///tmp/jetty-0_0_0_0-8080-war_war-_-any-4913003272580466620.dir/webapp/WEB-INF/lib/antlr4-4.5.jar!/org/antlr/v4/runtime/ANTLRErrorListener.class
datahub-gms               | 2021-08-06 00:59:13.252:WARN:oeja.AnnotationParser:qtp544724190-14: org.antlr.v4.runtime.ANTLRErrorStrategy scanned from multiple locations: jar:file:///tmp/jetty-0_0_0_0-8080-war_war-_-any-4913003272580466620.dir/webapp/WEB-INF/lib/antlr4-runtime-4.7.2.jar!/org/antlr/v4/runtime/ANTLRErrorStrategy.class, jar:file:///tmp/jetty-0_0_0_0-8080-war_war-_-any-4913003272580466620.dir/webapp/WEB-INF/lib/antlr4-4.5.jar!/org/antlr/v4/runtime/ANTLRErrorStrategy.class
datahub-gms               | 2021-08-06 00:59:13.253:WARN:oeja.AnnotationParser:qtp544724190-14: org.antlr.v4.runtime.BailErrorStrategy scanned from multiple locations: jar:file:///tmp/jetty-0_0_0_0-8080-war_war-_-any-4913003272580466620.dir/webapp/WEB-INF/lib/antlr4-runtime-4.7.2.jar!/org/antlr/v4/runtime/BailErrorStrategy.class, jar:file:///tmp/jetty-0_0_0_0-8080-war_war-_-any-4913003272580466620.dir/webapp/WEB-INF/lib/antlr4-4.5.jar!/org/antlr/v4/runtime/BailErrorStrategy.class
datahub-gms               | 2021-08-06 00:59:13.254:WARN:oeja.AnnotationParser:qtp544724190-14: org.antlr.v4.runtime.BaseErrorListener scanned from multiple locations: jar:file:///tmp/jetty-0_0_0_0-8080-war_war-_-any-4913003272580466620.dir/webapp/WEB-INF/lib/antlr4-runtime-4.7.2.jar!/org/antlr/v4/runtime/BaseErrorListener.class, jar:file:///tmp/jetty-0_0_0_0-8080-war_war-_-any-4913003272580466620.dir/webapp/WEB-INF/lib/antlr4-4.5.jar!/org/antlr/v4/runtime/BaseErrorListener.class
datahub-gms               | 2021-08-06 00:59:13.265:WARN:oeja.AnnotationParser:qtp544724190-14: org.antlr.v4.runtime.ConsoleErrorListener scanned from multiple locations: jar:file:///tmp/jetty-0_0_0_0-8080-war_war-_-any-4913003272580466620.dir/webapp/WEB-INF/lib/antlr4-runtime-4.7.2.jar!/org/antlr/v4/runtime/ConsoleErrorListener.class, jar:file:///tmp/jetty-0_0_0_0-8080-war_war-_-any-4913003272580466620.dir/webapp/WEB-INF/lib/antlr4-4.5.jar!/org/antlr/v4/runtime/ConsoleErrorListener.class
datahub-gms               | 2021-08-06 00:59:13.266:WARN:oeja.AnnotationParser:qtp544724190-14: org.antlr.v4.runtime.DefaultErrorStrategy scanned from multiple locations: jar:file:///tmp/jetty-0_0_0_0-8080-war_war-_-any-4913003272580466620.dir/webapp/WEB-INF/lib/antlr4-runtime-4.7.2.jar!/org/antlr/v4/runtime/DefaultErrorStrategy.class, jar:file:///tmp/jetty-0_0_0_0-8080-war_war-_-any-4913003272580466620.dir/webapp/WEB-INF/lib/antlr4-4.5.jar!/org/antlr/v4/runtime/DefaultErrorStrategy.class
datahub-gms               | 2021-08-06 00:59:13.266:WARN:oeja.AnnotationParser:qtp544724190-14: org.antlr.v4.runtime.DiagnosticErrorListener scanned from multiple locations: jar:file:///tmp/jetty-0_0_0_0-8080-war_war-_-any-4913003272580466620.dir/webapp/WEB-INF/lib/antlr4-runtime-4.7.2.jar!/org/antlr/v4/runtime/DiagnosticErrorListener.class, jar:file:///tmp/jetty-0_0_0_0-8080-war_war-_-any-4913003272580466620.dir/webapp/WEB-INF/lib/antlr4-4.5.jar!/org/antlr/v4/runtime/DiagnosticErrorListener.class
datahub-gms               | 2021-08-06 00:59:13.275:WARN:oeja.AnnotationParser:qtp544724190-14: org.antlr.v4.runtime.ProxyErrorListener scanned from multiple locations: jar:file:///tmp/jetty-0_0_0_0-8080-war_war-_-any-4913003272580466620.dir/webapp/WEB-INF/lib/antlr4-runtime-4.7.2.jar!/org/antlr/v4/runtime/ProxyErrorListener.class, jar:file:///tmp/jetty-0_0_0_0-8080-war_war-_-any-4913003272580466620.dir/webapp/WEB-INF/lib/antlr4-4.5.jar!/org/antlr/v4/runtime/ProxyErrorListener.class
datahub-gms               | 2021-08-06 00:59:13.314:WARN:oeja.AnnotationParser:qtp544724190-14: org.antlr.v4.runtime.atn.ErrorInfo scanned from multiple locations: jar:file:///tmp/jetty-0_0_0_0-8080-war_war-_-any-4913003272580466620.dir/webapp/WEB-INF/lib/antlr4-runtime-4.7.2.jar!/org/antlr/v4/runtime/atn/ErrorInfo.class, jar:file:///tmp/jetty-0_0_0_0-8080-war_war-_-any-4913003272580466620.dir/webapp/WEB-INF/lib/antlr4-4.5.jar!/org/antlr/v4/runtime/atn/ErrorInfo.class
broker                    | [2021-08-06 00:58:51,985] WARN [Producer clientId=producer-1] Error while fetching metadata with correlation id 6 : {__confluent.support.metrics=LEADER_NOT_AVAILABLE} (org.apache.kafka.clients.NetworkClient)
datahub-gms               | 2021-08-06 00:59:13.357:WARN:oeja.AnnotationParser:qtp544724190-14: org.antlr.v4.runtime.tree.ErrorNode scanned from multiple locations: jar:file:///tmp/jetty-0_0_0_0-8080-war_war-_-any-4913003272580466620.dir/webapp/WEB-INF/lib/antlr4-runtime-4.7.2.jar!/org/antlr/v4/runtime/tree/ErrorNode.class, jar:file:///tmp/jetty-0_0_0_0-8080-war_war-_-any-4913003272580466620.dir/webapp/WEB-INF/lib/antlr4-4.5.jar!/org/antlr/v4/runtime/tree/ErrorNode.class
datahub-gms               | 2021-08-06 00:59:13.357:WARN:oeja.AnnotationParser:qtp544724190-14: org.antlr.v4.runtime.tree.ErrorNodeImpl scanned from multiple locations: jar:file:///tmp/jetty-0_0_0_0-8080-war_war-_-any-4913003272580466620.dir/webapp/WEB-INF/lib/antlr4-runtime-4.7.2.jar!/org/antlr/v4/runtime/tree/ErrorNodeImpl.class, jar:file:///tmp/jetty-0_0_0_0-8080-war_war-_-any-4913003272580466620.dir/webapp/WEB-INF/lib/antlr4-4.5.jar!/org/antlr/v4/runtime/tree/ErrorNodeImpl.class
datahub-gms               | 2021-08-06 00:59:13.382:WARN:oeja.AnnotationParser:qtp544724190-14: org.antlr.v4.runtime.tree.xpath.XPathLexerErrorListener scanned from multiple locations: jar:file:///tmp/jetty-0_0_0_0-8080-war_war-_-any-4913003272580466620.dir/webapp/WEB-INF/lib/antlr4-runtime-4.7.2.jar!/org/antlr/v4/runtime/tree/xpath/XPathLexerErrorListener.class, jar:file:///tmp/jetty-0_0_0_0-8080-war_war-_-any-4913003272580466620.dir/webapp/WEB-INF/lib/antlr4-4.5.jar!/org/antlr/v4/runtime/tree/xpath/XPathLexerErrorListener.class
datahub-gms               | 2021-08-06 00:59:13.430:WARN:oeja.AnnotationParser:qtp544724190-14: org.stringtemplate.v4.STErrorListener scanned from multiple locations: jar:file:///tmp/jetty-0_0_0_0-8080-war_war-_-any-4913003272580466620.dir/webapp/WEB-INF/lib/ST4-4.0.8.jar!/org/stringtemplate/v4/STErrorListener.class, jar:file:///tmp/jetty-0_0_0_0-8080-war_war-_-any-4913003272580466620.dir/webapp/WEB-INF/lib/antlr4-4.5.jar!/org/stringtemplate/v4/STErrorListener.class
datahub-gms               | 2021-08-06 00:59:13.479:WARN:oeja.AnnotationParser:qtp544724190-14: org.stringtemplate.v4.misc.ErrorBuffer scanned from multiple locations: jar:file:///tmp/jetty-0_0_0_0-8080-war_war-_-any-4913003272580466620.dir/webapp/WEB-INF/lib/ST4-4.0.8.jar!/org/stringtemplate/v4/misc/ErrorBuffer.class, jar:file:///tmp/jetty-0_0_0_0-8080-war_war-_-any-4913003272580466620.dir/webapp/WEB-INF/lib/antlr4-4.5.jar!/org/stringtemplate/v4/misc/ErrorBuffer.class
datahub-gms               | 2021-08-06 00:59:13.479:WARN:oeja.AnnotationParser:qtp544724190-14: org.stringtemplate.v4.misc.ErrorManager$1 scanned from multiple locations: jar:file:///tmp/jetty-0_0_0_0-8080-war_war-_-any-4913003272580466620.dir/webapp/WEB-INF/lib/ST4-4.0.8.jar!/org/stringtemplate/v4/misc/ErrorManager$1.class, jar:file:///tmp/jetty-0_0_0_0-8080-war_war-_-any-4913003272580466620.dir/webapp/WEB-INF/lib/antlr4-4.5.jar!/org/stringtemplate/v4/misc/ErrorManager$1.class
datahub-gms               | 2021-08-06 00:59:13.479:WARN:oeja.AnnotationParser:qtp544724190-14: org.stringtemplate.v4.misc.ErrorManager scanned from multiple locations: jar:file:///tmp/jetty-0_0_0_0-8080-war_war-_-any-4913003272580466620.dir/webapp/WEB-INF/lib/ST4-4.0.8.jar!/org/stringtemplate/v4/misc/ErrorManager.class, jar:file:///tmp/jetty-0_0_0_0-8080-war_war-_-any-4913003272580466620.dir/webapp/WEB-INF/lib/antlr4-4.5.jar!/org/stringtemplate/v4/misc/ErrorManager.class
datahub-gms               | 2021-08-06 00:59:13.480:WARN:oeja.AnnotationParser:qtp544724190-14: org.stringtemplate.v4.misc.ErrorType scanned from multiple locations: jar:file:///tmp/jetty-0_0_0_0-8080-war_war-_-any-4913003272580466620.dir/webapp/WEB-INF/lib/ST4-4.0.8.jar!/org/stringtemplate/v4/misc/ErrorType.class, jar:file:///tmp/jetty-0_0_0_0-8080-war_war-_-any-4913003272580466620.dir/webapp/WEB-INF/lib/antlr4-4.5.jar!/org/stringtemplate/v4/misc/ErrorType.class
datahub-gms               | 2021-08-06 00:59:14.643:WARN:oeja.AnnotationParser:qtp544724190-16: javax.ws.rs.ClientErrorException scanned from multiple locations: jar:file:///tmp/jetty-0_0_0_0-8080-war_war-_-any-4913003272580466620.dir/webapp/WEB-INF/lib/jakarta.ws.rs-api-2.1.6.jar!/javax/ws/rs/ClientErrorException.class, jar:file:///tmp/jetty-0_0_0_0-8080-war_war-_-any-4913003272580466620.dir/webapp/WEB-INF/lib/javax.ws.rs-api-2.1.1.jar!/javax/ws/rs/ClientErrorException.class
datahub-gms               | 2021-08-06 00:59:14.646:WARN:oeja.AnnotationParser:qtp544724190-16: javax.ws.rs.InternalServerErrorException scanned from multiple locations: jar:file:///tmp/jetty-0_0_0_0-8080-war_war-_-any-4913003272580466620.dir/webapp/WEB-INF/lib/jakarta.ws.rs-api-2.1.6.jar!/javax/ws/rs/InternalServerErrorException.class, jar:file:///tmp/jetty-0_0_0_0-8080-war_war-_-any-4913003272580466620.dir/webapp/WEB-INF/lib/javax.ws.rs-api-2.1.1.jar!/javax/ws/rs/InternalServerErrorException.class
datahub-gms               | 2021-08-06 00:59:14.655:WARN:oeja.AnnotationParser:qtp544724190-16: javax.ws.rs.ServerErrorException scanned from multiple locations: jar:file:///tmp/jetty-0_0_0_0-8080-war_war-_-any-4913003272580466620.dir/webapp/WEB-INF/lib/jakarta.ws.rs-api-2.1.6.jar!/javax/ws/rs/ServerErrorException.class, jar:file:///tmp/jetty-0_0_0_0-8080-war_war-_-any-4913003272580466620.dir/webapp/WEB-INF/lib/javax.ws.rs-api-2.1.1.jar!/javax/ws/rs/ServerErrorException.class

Hope it would be helpful ...

Light310 commented 3 years ago

Hello, I've had the same issue, you can check latest comments in this thread : https://github.com/linkedin/datahub/issues/2791 Fixing memory limits for datahub-gms container helped me.

frankShih commented 3 years ago

Hi @Light310 , thanks for you help.

I change the mem_limit in yaml file, and run datahub docker quickstart --quickstart-compose-file docker-compose-without-neo4j.quickstart.yml. Then services start without showing errors

✔ DataHub is now running
Ingest some demo data using `datahub docker ingest-sample-data`,
or head to http://localhost:9002 (username: datahub, password: datahub) to play around with the frontend.

However, when I check docker ps -a, some services already exited: image

Does it mean that all 'setup' services should be terminated after the main services start?

jjoyce0510 commented 3 years ago

@frankShih Yes it does!

This was a known issue associated with artificially constrained memory for the GMS container, as you guys have already identified. In the latest release, these have been removed in v0.8.9: https://github.com/linkedin/datahub/releases.

Thanks for your patience ! Hoping everything has been working since.

John