AbsaOSS / spline-getting-started

Apache License 2.0
24 stars 17 forks source link

When I try with document, I got "Server is unavailable." error in Web UI #48

Open Sangrho opened 1 year ago

Sangrho commented 1 year ago
docker run -p 8529:8529 -e ARANGO_NO_AUTH=1 arangodb/arangodb:3.9.6
docker run -it --rm absaoss/spline-admin:0.7.7 db-init arangodb://172.17.0.1/spline
docker container run \
  -e SPLINE_DATABASE_CONNECTION_URL=arangodb:///172.17.0.1/spline \
  -p 8080:8080 \
  absaoss/spline-rest-server:0.7.7
docker container run \
      -e SPLINE_CONSUMER_URL=http://localhost:8080/consumer \
      -p 9090:8080 \
      absaoss/spline-web-ui:0.7.4

image

wajda commented 1 year ago

Please check your docker networking, and the server logs.

Sangrho commented 1 year ago

@wajda Thank you for your kindness !

There are any error logs in web ui docker conatiner.

[root@ip-10-117-104-75 ~]# docker container run --memory=10g       -e SPLINE_CONSUMER_URL=http://localhost:18088/consumer       -p 9090:8080       absaoss/spline-web-ui:0.7.4
10-Jul-2023 12:25:07.557 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Server version name:   Apache Tomcat/9.0.45
10-Jul-2023 12:25:07.558 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Server built:          Mar 30 2021 10:29:04 UTC
10-Jul-2023 12:25:07.558 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Server version number: 9.0.45.0
10-Jul-2023 12:25:07.558 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log OS Name:               Linux
10-Jul-2023 12:25:07.558 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log OS Version:            4.14.311-233.529.amzn2.x86_64
10-Jul-2023 12:25:07.558 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Architecture:          amd64
10-Jul-2023 12:25:07.559 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Java Home:             /usr/local/openjdk-8/jre
10-Jul-2023 12:25:07.559 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log JVM Version:           1.8.0_292-b10
10-Jul-2023 12:25:07.559 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log JVM Vendor:            Oracle Corporation
10-Jul-2023 12:25:07.559 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log CATALINA_BASE:         /usr/local/tomcat
10-Jul-2023 12:25:07.559 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log CATALINA_HOME:         /usr/local/tomcat
10-Jul-2023 12:25:07.560 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Djava.util.logging.config.file=/usr/local/tomcat/conf/logging.properties
10-Jul-2023 12:25:07.560 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Djava.util.logging.manager=org.apache.juli.ClassLoaderLogManager
10-Jul-2023 12:25:07.560 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Djdk.tls.ephemeralDHKeySize=2048
10-Jul-2023 12:25:07.560 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Djava.protocol.handler.pkgs=org.apache.catalina.webresources
10-Jul-2023 12:25:07.560 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Dorg.apache.catalina.security.SecurityListener.UMASK=0027
10-Jul-2023 12:25:07.560 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Dignore.endorsed.dirs=
10-Jul-2023 12:25:07.560 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Dcatalina.base=/usr/local/tomcat
10-Jul-2023 12:25:07.560 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Dcatalina.home=/usr/local/tomcat
10-Jul-2023 12:25:07.560 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Djava.io.tmpdir=/usr/local/tomcat/temp
10-Jul-2023 12:25:07.563 INFO [main] org.apache.catalina.core.AprLifecycleListener.lifecycleEvent Loaded Apache Tomcat Native library [1.2.27] using APR version [1.6.5].
10-Jul-2023 12:25:07.563 INFO [main] org.apache.catalina.core.AprLifecycleListener.lifecycleEvent APR capabilities: IPv6 [true], sendfile [true], accept filters [false], random [true].
10-Jul-2023 12:25:07.563 INFO [main] org.apache.catalina.core.AprLifecycleListener.lifecycleEvent APR/OpenSSL configuration: useAprConnector [false], useOpenSSL [true]
10-Jul-2023 12:25:07.566 INFO [main] org.apache.catalina.core.AprLifecycleListener.initializeSSL OpenSSL successfully initialized [OpenSSL 1.1.1d  10 Sep 2019]
10-Jul-2023 12:25:07.766 INFO [main] org.apache.coyote.AbstractProtocol.init Initializing ProtocolHandler ["http-nio-8080"]
10-Jul-2023 12:25:07.781 INFO [main] org.apache.catalina.startup.Catalina.load Server initialization in [350] milliseconds
10-Jul-2023 12:25:07.800 INFO [main] org.apache.catalina.core.StandardService.startInternal Starting service [Catalina]
10-Jul-2023 12:25:07.800 INFO [main] org.apache.catalina.core.StandardEngine.startInternal Starting Servlet engine: [Apache Tomcat/9.0.45]
10-Jul-2023 12:25:07.814 INFO [main] org.apache.catalina.startup.HostConfig.deployWAR Deploying web application archive [/usr/local/tomcat/webapps/ROOT.war]
10-Jul-2023 12:25:08.410 INFO [main] org.apache.jasper.servlet.TldScanner.scanJars At least one JAR was scanned for TLDs yet contained no TLDs. Enable debug logging for this logger for a complete list of JARs that were scanned but no TLDs were found in them. Skipping unneeded JARs during scanning can improve startup time and JSP compilation time.
10-Jul-2023 12:25:08.774 INFO [main] org.apache.catalina.startup.HostConfig.deployWAR Deployment of web application archive [/usr/local/tomcat/webapps/ROOT.war] has finished in [959] ms
10-Jul-2023 12:25:08.776 INFO [main] org.apache.coyote.AbstractProtocol.start Starting ProtocolHandler ["http-nio-8080"]
10-Jul-2023 12:25:08.782 INFO [main] org.apache.catalina.startup.Catalina.start Server startup in [1000] milliseconds
wajda commented 1 year ago

Not the UI, I meant the REST server one.

Sangrho commented 1 year ago

That is also any error logs not occurs.

[root@ip-10-117-104-75 ~]# docker logs -f 5a4d220278ea
NOTE: Picked up JDK_JAVA_OPTIONS:  --add-opens=java.base/java.lang=ALL-UNNAMED --add-opens=java.base/java.io=ALL-UNNAMED --add-opens=java.base/java.util=ALL-UNNAMED --add-opens=java.base/java.util.concurrent=ALL-UNNAMED --add-opens=java.rmi/sun.rmi.transport=ALL-UNNAMED
10-Jul-2023 12:20:27.378 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Server version name:   Apache Tomcat/9.0.45
10-Jul-2023 12:20:27.381 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Server built:          Mar 30 2021 10:29:04 UTC
10-Jul-2023 12:20:27.381 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Server version number: 9.0.45.0
10-Jul-2023 12:20:27.381 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log OS Name:               Linux
10-Jul-2023 12:20:27.381 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log OS Version:            4.14.311-233.529.amzn2.x86_64
10-Jul-2023 12:20:27.381 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Architecture:          amd64
10-Jul-2023 12:20:27.381 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Java Home:             /usr/lib/jvm/java-11-amazon-corretto
10-Jul-2023 12:20:27.381 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log JVM Version:           11.0.11+9-LTS
10-Jul-2023 12:20:27.381 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log JVM Vendor:            Amazon.com Inc.
10-Jul-2023 12:20:27.381 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log CATALINA_BASE:         /usr/local/tomcat
10-Jul-2023 12:20:27.382 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log CATALINA_HOME:         /usr/local/tomcat
10-Jul-2023 12:20:27.391 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: --add-opens=java.base/java.lang=ALL-UNNAMED
10-Jul-2023 12:20:27.391 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: --add-opens=java.base/java.io=ALL-UNNAMED
10-Jul-2023 12:20:27.391 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: --add-opens=java.base/java.util=ALL-UNNAMED
10-Jul-2023 12:20:27.391 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: --add-opens=java.base/java.util.concurrent=ALL-UNNAMED
10-Jul-2023 12:20:27.391 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: --add-opens=java.rmi/sun.rmi.transport=ALL-UNNAMED
10-Jul-2023 12:20:27.391 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Djava.util.logging.config.file=/usr/local/tomcat/conf/logging.properties
10-Jul-2023 12:20:27.391 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Djava.util.logging.manager=org.apache.juli.ClassLoaderLogManager
10-Jul-2023 12:20:27.391 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Djdk.tls.ephemeralDHKeySize=2048
10-Jul-2023 12:20:27.392 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Djava.protocol.handler.pkgs=org.apache.catalina.webresources
10-Jul-2023 12:20:27.392 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Dorg.apache.catalina.security.SecurityListener.UMASK=0027
10-Jul-2023 12:20:27.392 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Dignore.endorsed.dirs=
10-Jul-2023 12:20:27.392 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Dcatalina.base=/usr/local/tomcat
10-Jul-2023 12:20:27.392 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Dcatalina.home=/usr/local/tomcat
10-Jul-2023 12:20:27.392 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Djava.io.tmpdir=/usr/local/tomcat/temp
10-Jul-2023 12:20:27.395 INFO [main] org.apache.catalina.core.AprLifecycleListener.lifecycleEvent Loaded Apache Tomcat Native library [1.2.27] using APR version [1.6.3].
10-Jul-2023 12:20:27.395 INFO [main] org.apache.catalina.core.AprLifecycleListener.lifecycleEvent APR capabilities: IPv6 [true], sendfile [true], accept filters [false], random [true].
10-Jul-2023 12:20:27.396 INFO [main] org.apache.catalina.core.AprLifecycleListener.lifecycleEvent APR/OpenSSL configuration: useAprConnector [false], useOpenSSL [true]
10-Jul-2023 12:20:27.398 INFO [main] org.apache.catalina.core.AprLifecycleListener.initializeSSL OpenSSL successfully initialized [OpenSSL 1.0.2k-fips  26 Jan 2017]
10-Jul-2023 12:20:27.624 INFO [main] org.apache.coyote.AbstractProtocol.init Initializing ProtocolHandler ["http-nio-8080"]
10-Jul-2023 12:20:27.648 INFO [main] org.apache.catalina.startup.Catalina.load Server initialization in [427] milliseconds
10-Jul-2023 12:20:27.688 INFO [main] org.apache.catalina.core.StandardService.startInternal Starting service [Catalina]
10-Jul-2023 12:20:27.688 INFO [main] org.apache.catalina.core.StandardEngine.startInternal Starting Servlet engine: [Apache Tomcat/9.0.45]
10-Jul-2023 12:20:27.690 SEVERE [main] org.apache.catalina.startup.HostConfig.beforeStart Unable to create directory for deployment: [/usr/local/tomcat/conf/Catalina/localhost]
10-Jul-2023 12:20:27.694 INFO [main] org.apache.catalina.startup.HostConfig.deployDirectory Deploying web application directory [/usr/local/tomcat/webapps/ROOT]
10-Jul-2023 12:20:31.145 INFO [main] org.apache.jasper.servlet.TldScanner.scanJars At least one JAR was scanned for TLDs yet contained no TLDs. Enable debug logging for this logger for a complete list of JARs that were scanned but no TLDs were found in them. Skipping unneeded JARs during scanning can improve startup time and JSP compilation time.
12:20:31.585 [main] INFO  o.s.web.context.ContextLoader - Root WebApplicationContext: initialization started
12:20:32.063 [main] INFO  z.c.a.s.p.ArangoRepoConfig$$EnhancerBySpringCGLIB$$9631a355 - Spline database URL: arangodb://172.17.0.3:8529/spline
12:20:32.501 [main] INFO  o.s.web.context.ContextLoader - Root WebApplicationContext initialized in 914 ms
12:20:32.520 [main] INFO  o.s.web.servlet.DispatcherServlet - Initializing Servlet 'aboutDispatcher'
12:20:33.065 [main] INFO  o.s.web.servlet.DispatcherServlet - Completed initialization in 544 ms
12:20:33.065 [main] INFO  o.s.web.servlet.DispatcherServlet - Initializing Servlet 'producerDispatcher'
12:20:33.195 [main] INFO  o.s.c.s.PostProcessorRegistrationDelegate$BeanPostProcessorChecker - Bean 'producerRESTConfig' of type [za.co.absa.spline.producer.rest.ProducerRESTConfig$$EnhancerBySpringCGLIB$$76ee65d2] is not eligible for getting processed by all BeanPostProcessors (for example: not eligible for auto-proxying)
12:20:33.562 [main] INFO  o.h.validator.internal.util.Version - HV000001: Hibernate Validator 7.0.1.Final
12:20:33.896 [main] INFO  o.s.web.servlet.DispatcherServlet - Completed initialization in 831 ms
12:20:33.896 [main] INFO  o.s.web.servlet.DispatcherServlet - Initializing Servlet 'consumerDispatcher'
12:20:33.925 [main] INFO  o.s.c.s.PostProcessorRegistrationDelegate$BeanPostProcessorChecker - Bean 'consumerRESTConfig' of type [za.co.absa.spline.consumer.rest.ConsumerRESTConfig$$EnhancerBySpringCGLIB$$d955069a] is not eligible for getting processed by all BeanPostProcessors (for example: not eligible for auto-proxying)
12:20:33.984 [main] INFO  o.s.web.servlet.DispatcherServlet - Completed initialization in 88 ms
10-Jul-2023 12:20:33.994 INFO [main] org.apache.catalina.startup.HostConfig.deployDirectory Deployment of web application directory [/usr/local/tomcat/webapps/ROOT] has finished in [6,300] ms
10-Jul-2023 12:20:33.997 INFO [main] org.apache.coyote.AbstractProtocol.start Starting ProtocolHandler ["http-nio-8080"]
10-Jul-2023 12:20:34.003 INFO [main] org.apache.catalina.startup.Catalina.start Server startup in [6354] milliseconds

What am I miss?

I think spline is awsome data lineage tool which I looking for with Spark better than Apache Atlas which not support Spark.

wajda commented 1 year ago

It all looks good. The problem is most likely somewhere in your networking config. One more clarifying question - are you running containers on the same host on which you run the browser?

SPLINE_CONSUMER_URL=http://localhost:8080/consumer

The URL above must be accessible from the user browser

Sangrho commented 1 year ago

@wajda Thank you for your kindness !!

I use only one instance.

I can connect https://localhost:8080 but when I connect https://localhost:8080/consumer I got below in server log

05:29:59.915 [http-nio-8080-exec-9] WARN  o.s.web.servlet.PageNotFound - No mapping for GET /consumer

and I got http 404 error in web ui.

What am I miss?

wajda commented 1 year ago

that's fine /consumer is a base URL, there is no direct HTTP GET mapping on it. Try this URL in the browser - https://localhost/consumer/execution-events. If it works then the UI should work as well.

Sangrho commented 1 year ago

When I open https://localhost:8080/consumer/execution-events I got below values

{"items":[],"totalCount":0,"pageNum":1,"pageSize":10,"totalDateRange":[]}

But https://localhost:9090/ have same issue.

wajda commented 1 year ago

Open a Dev browser console (F12 in Chrome) and check the network tab. The browser makes requests to that endpoint via REST. Check if everything is OK there

Sangrho commented 1 year ago

@wajda I think it is not OK image What am I miss !?

wajda commented 1 year ago

@wajda I think it is not OK

I don't think so either. Look at the error code and message, then look at the server logs, do some investigation.

Thaanish-Ahamed-08 commented 2 weeks ago

@Sangrho, Facing the same issue. Found any solution for this?