open-metadata / OpenMetadata

OpenMetadata is a unified metadata platform for data discovery, data observability, and data governance powered by a central metadata repository, in-depth column level lineage, and seamless team collaboration.
https://open-metadata.org
Apache License 2.0
5.52k stars 1.04k forks source link

No key found in with kid - Self-signed certificate #9525

Closed Unanimad closed 1 year ago

Unanimad commented 1 year ago

Affected module UI and backend

Describe the bug Following the instruction to generate self-sign certificate as described in Create Self-Signed Certificate, restart the server and try to sign in:

An exception with message [No key found in with kid Gb389a-9f76-gdjs-a92j-0242bk94356] was thrown while processing request.

To Reproduce

After restart the server, do the login at https://localhost:8585/ and the error is raised, as the image below:

Also, the credentials of the current user isn't showed:

Expected behavior Use normally the server with https enabled.

Version:

Additional context


openmetadata.yaml

  rootPath: '/api/*'
  applicationConnectors:
    - type: https
      port: ${SERVER_PORT:-8585}
      keyStorePath: ./conf/openmetadata.keystore.jks
      keyStorePassword: test12
      keyStoreType: JKS
      supportedProtocols: [TLSv1.2, TLSv1.3]
      excludedProtocols: [SSL, SSLv2, SSLv2Hello, SSLv3]

docker-compose.yml

#  Licensed under the Apache License, Version 2.0 (the "License");
#  you may not use this file except in compliance with the License.
#  You may obtain a copy of the License at
#  http://www.apache.org/licenses/LICENSE-2.0
#  Unless required by applicable law or agreed to in writing, software
#  distributed under the License is distributed on an "AS IS" BASIS,
#  WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
#  See the License for the specific language governing permissions and
#  limitations under the License.

version: "3.9"
volumes:
  ingestion-volume-dag-airflow:
  ingestion-volume-dags:
  ingestion-volume-tmp:
services:
  mysql:
    container_name: openmetadata_mysql
    image: openmetadata/db:0.13.0
    restart: always
    environment:
      MYSQL_ROOT_PASSWORD: password
    expose:
      - 3306
    volumes:
      - ./docker-volume/db-data:/var/lib/mysql
    networks:
      - app_net
    healthcheck:
      test: mysql --user=root --password=$$MYSQL_ROOT_PASSWORD --silent --execute "use openmetadata_db"
      interval: 15s
      timeout: 10s
      retries: 10

  opensearch:
    image: opensearchproject/opensearch:1.3.7
    expose:
      - 9200
      - 9600
    ports:
      - "9200:9200"
      - "9600:9600"
    environment:
      - discovery.type=single-node
      - "OPENSEARCH_JAVA_OPTS=-Xms1024m -Xmx1024m"
      - network.host=0.0.0.0
      - ELASTIC_USER=admin
      - ELASTIC_PASSWORD=admin
    ulimits: # Tunning recomendado pelo fabricante do OpenSearch
      memlock:
        soft: -1
        hard: -1
    networks:
      - app_net

  #  elasticsearch:
  #    container_name: openmetadata_elasticsearch
  #    image: docker.elastic.co/elasticsearch/elasticsearch:7.10.2
  #    environment:
  #      - discovery.type=single-node
  #      - ES_JAVA_OPTS=-Xms1024m -Xmx1024m
  #    networks:
  #      - app_net
  #    ports:
  #      - "9200:9200"
  #      - "9300:9300"

  openmetadata-server:
    container_name: openmetadata_server
    restart: always
    image: openmetadata/server:0.13.0
    environment:
      # OpenMetadata Server Authentication Configuration
      AUTHORIZER_CLASS_NAME: ${AUTHORIZER_CLASS_NAME:-org.openmetadata.service.security.DefaultAuthorizer}
      AUTHORIZER_REQUEST_FILTER: ${AUTHORIZER_REQUEST_FILTER:-org.openmetadata.service.security.JwtFilter}
      AUTHORIZER_ADMIN_PRINCIPALS: ${AUTHORIZER_ADMIN_PRINCIPALS:-[admin]}
      AUTHORIZER_ALLOWED_REGISTRATION_DOMAIN: ${AUTHORIZER_ALLOWED_REGISTRATION_DOMAIN:-["all"]}
      AUTHORIZER_INGESTION_PRINCIPALS: ${AUTHORIZER_INGESTION_PRINCIPALS:-[ingestion-bot]}
      AUTHORIZER_PRINCIPAL_DOMAIN: ${AUTHORIZER_PRINCIPAL_DOMAIN:-"openmetadata.org"}
      AUTHORIZER_ENFORCE_PRINCIPAL_DOMAIN: ${AUTHORIZER_ENFORCE_PRINCIPAL_DOMAIN:-false}
      AUTHORIZER_ENABLE_SECURE_SOCKET: ${AUTHORIZER_ENABLE_SECURE_SOCKET:-false}
      AUTHENTICATION_PROVIDER: ${AUTHENTICATION_PROVIDER:-basic}
      CUSTOM_OIDC_AUTHENTICATION_PROVIDER_NAME: ${CUSTOM_OIDC_AUTHENTICATION_PROVIDER_NAME:-""}
      AUTHENTICATION_PUBLIC_KEYS: ${AUTHENTICATION_PUBLIC_KEYS:-[https://localhost:8585/api/v1/config/jwks]}
      AUTHENTICATION_AUTHORITY: ${AUTHENTICATION_AUTHORITY:-https://accounts.google.com}
      AUTHENTICATION_CLIENT_ID: ${AUTHENTICATION_CLIENT_ID:-""}
      AUTHENTICATION_CALLBACK_URL: ${AUTHENTICATION_CALLBACK_URL:-""}
      AUTHENTICATION_JWT_PRINCIPAL_CLAIMS: ${AUTHENTICATION_JWT_PRINCIPAL_CLAIMS:-[email,preferred_username,sub]}
      AUTHENTICATION_ENABLE_SELF_SIGNUP: ${AUTHENTICATION_ENABLE_SELF_SIGNUP:-true}
      # JWT Configuration
      RSA_PUBLIC_KEY_FILE_PATH: ${RSA_PUBLIC_KEY_FILE_PATH:-"./conf/public_key.der"}
      RSA_PRIVATE_KEY_FILE_PATH: ${RSA_PRIVATE_KEY_FILE_PATH:-"./conf/private_key.der"}
      JWT_ISSUER: ${JWT_ISSUER:-"open-metadata.org"}
      JWT_KEY_ID: ${JWT_KEY_ID:-"Gb389a-9f76-gdjs-a92j-0242bk94356"}
      # OpenMetadata Server Airflow Configuration
      AIRFLOW_HOST: ${AIRFLOW_HOST:-http://ingestion:8080}
      SERVER_HOST_API_URL: ${SERVER_HOST_API_URL:-http://openmetadata-server:8585/api}
      AIRFLOW_AUTH_PROVIDER: ${AIRFLOW_AUTH_PROVIDER:-no-auth}
      # OpenMetadata Airflow Azure SSO Configuration
      OM_AUTH_AIRFLOW_AZURE_CLIENT_SECRET: ${OM_AUTH_AIRFLOW_AZURE_CLIENT_SECRET:-""}
      OM_AUTH_AIRFLOW_AZURE_AUTHORITY_URL: ${OM_AUTH_AIRFLOW_AZURE_AUTHORITY_URL:-""}
      OM_AUTH_AIRFLOW_AZURE_SCOPES: ${OM_AUTH_AIRFLOW_AZURE_SCOPES:-[]}
      OM_AUTH_AIRFLOW_AZURE_CLIENT_ID: ${OM_AUTH_AIRFLOW_AZURE_CLIENT_ID:-""}
      # OpenMetadata Airflow Google SSO Configuration
      OM_AUTH_AIRFLOW_GOOGLE_SECRET_KEY_PATH: ${OM_AUTH_AIRFLOW_GOOGLE_SECRET_KEY_PATH:- ""}
      OM_AUTH_AIRFLOW_GOOGLE_AUDIENCE: ${OM_AUTH_AIRFLOW_GOOGLE_AUDIENCE:-"https://www.googleapis.com/oauth2/v4/token"}
      # OpenMetadata Airflow Okta SSO Configuration
      OM_AUTH_AIRFLOW_OKTA_CLIENT_ID: ${OM_AUTH_AIRFLOW_OKTA_CLIENT_ID:-""}
      OM_AUTH_AIRFLOW_OKTA_ORGANIZATION_URL: ${OM_AUTH_AIRFLOW_OKTA_ORGANIZATION_URL:-""}
      OM_AUTH_AIRFLOW_OKTA_PRIVATE_KEY: ${OM_AUTH_AIRFLOW_OKTA_PRIVATE_KEY:-""}
      OM_AUTH_AIRFLOW_OKTA_SA_EMAIL: ${OM_AUTH_AIRFLOW_OKTA_SA_EMAIL:-""}
      OM_AUTH_AIRFLOW_OKTA_SCOPES: ${OM_AUTH_AIRFLOW_OKTA_SCOPES:-[]}
      # OpenMetadata Airflow Auth0 SSO Configuration
      OM_AUTH_AIRFLOW_AUTH0_CLIENT_ID: ${OM_AUTH_AIRFLOW_AUTH0_CLIENT_ID:-""}
      OM_AUTH_AIRFLOW_AUTH0_CLIENT_SECRET: ${OM_AUTH_AIRFLOW_AUTH0_CLIENT_SECRET:-""}
      OM_AUTH_AIRFLOW_AUTH0_DOMAIN_URL: ${OM_AUTH_AIRFLOW_AUTH0_DOMAIN_URL:-""}
      # OpenMetadata Airflow Custom OIDC SSO Configuration
      OM_AUTH_AIRFLOW_CUSTOM_OIDC_CLIENT_ID: ${OM_AUTH_AIRFLOW_CUSTOM_OIDC_CLIENT_ID:-""}
      OM_AUTH_AIRFLOW_CUSTOM_OIDC_SECRET_KEY: ${OM_AUTH_AIRFLOW_CUSTOM_OIDC_SECRET_KEY:-""}
      OM_AUTH_AIRFLOW_CUSTOM_OIDC_TOKEN_ENDPOINT_URL: ${OM_AUTH_AIRFLOW_CUSTOM_OIDC_TOKEN_ENDPOINT_URL:-""}
      # OpenMetadata Airflow JWT Token Configuration
      OM_AUTH_JWT_TOKEN: ${OM_AUTH_JWT_TOKEN:-""}
      # Database configuration for MySQL
      DB_DRIVER_CLASS: ${DB_DRIVER_CLASS:-com.mysql.cj.jdbc.Driver}
      DB_SCHEME: ${DB_SCHEME:-mysql}
      DB_USE_SSL: ${DB_USE_SSL:-false}
      DB_USER: ${DB_USER:-openmetadata_user}
      DB_USER_PASSWORD: ${DB_USER_PASSWORD:-openmetadata_password}
      DB_HOST: ${DB_HOST:-mysql}
      DB_PORT: ${DB_PORT:-3306}
      OM_DATABASE: ${OM_DATABASE:-openmetadata_db}
      # Airflow SSL Configurations
      AIRFLOW_VERIFY_SSL: ${AIRFLOW_VERIFY_SSL:-"no-ssl"}
      AIRFLOW_SSL_CERT_PATH: ${AIRFLOW_SSL_CERT_PATH:-""}
      # ElasticSearch Configurations
      ELASTICSEARCH_HOST: ${ELASTICSEARCH_HOST:-opensearch}
      ELASTICSEARCH_PORT: ${ELASTICSEARCH_PORT:-9200}
      ELASTICSEARCH_SCHEME: ${ELASTICSEARCH_SCHEME:-https}
      ELASTICSEARCH_USER: ${ELASTICSEARCH_USER:-"admin"}
      ELASTICSEARCH_PASSWORD: ${ELASTICSEARCH_PASSWORD:-"admin"}
      # Heap OPTS Configurations
      OPENMETADATA_HEAP_OPTS: ${OPENMETADATA_HEAP_OPTS:--Xmx1G -Xms1G}
    expose:
      - 8585
      - 8586
    ports:
      - "8585:8585"
      - "8586:8586"
    depends_on:
      mysql:
        condition: service_healthy
    networks:
      - app_net
    healthcheck:
      test: [ "CMD", "curl", "-f", "http://localhost:8586/healthcheck" ]

  ingestion:
    container_name: openmetadata_ingestion
    image: openmetadata/ingestion:0.13.0
    depends_on:
      mysql:
        condition: service_healthy
      openmetadata-server:
        condition: service_healthy
    environment:
      AIRFLOW__API__AUTH_BACKENDS: airflow.api.auth.backend.basic_auth
      AIRFLOW__CORE__EXECUTOR: LocalExecutor
      AIRFLOW__OPENMETADATA_AIRFLOW_APIS__DAG_GENERATED_CONFIGS: "/opt/airflow/dag_generated_configs"
      DB_HOST: ${AIRFLOW_DB_HOST:-mysql}
      DB_PORT: ${AIRFLOW_DB_PORT:-3306}
      AIRFLOW_DB: ${AIRFLOW_DB:-airflow_db}
      AIRFLOW_DB_SCHEME: ${AIRFLOW_DB_SCHEME:-mysql+pymysql}
      DB_USER: ${AIRFLOW_DB_USER:-airflow_user}
      DB_PASSWORD: ${AIRFLOW_DB_PASSWORD:-airflow_pass}
    entrypoint: /bin/bash
    command:
      - "/opt/airflow/ingestion_dependency.sh"
    expose:
      - 8080
    ports:
      - "8080:8080"
    networks:
      - app_net
    volumes:
      - ingestion-volume-dag-airflow:/opt/airflow/dag_generated_configs
      - ingestion-volume-dags:/opt/airflow/dags
      - ingestion-volume-tmp:/tmp

networks:
  app_net:
    ipam:
      driver: default
      config:
        - subnet: "172.16.240.0/24"
bdnf commented 1 year ago

Hi all, We've detected the same issue after running this docker-compose file. Variables are set properly inside the openmetadata_server container

echo $AUTHENTICATION_PUBLIC_KEYS 
[http://localhost:8585/api/v1/system/config/jwks]
/ # echo $SERVER_HOST_API_URL
http://openmetadata-server:8585/api

Similar exception is also happening when Sample_data DAG is triggered from Airflow. DAG execution fails and the stacktrace is present in openmetadata_server

Sorry for pasting the full exception trace, but it could be helpful

openmetadata_server         | 172.16.240.5 - - [21/Mar/2023:11:06:31 +0000] "GET /api/v1/version HTTP/1.1" 200 100 "-" "python-requests/2.28.0" 11
openmetadata_server         | 172.16.240.5 - - [21/Mar/2023:11:06:31 +0000] "GET /api/v1/version HTTP/1.1" 200 100 "-" "python-requests/2.28.0" 3
openmetadata_server         | 172.16.240.5 - - [21/Mar/2023:11:06:31 +0000] "GET /api/v1/version HTTP/1.1" 200 100 "-" "python-requests/2.28.0" 2
openmetadata_server         | INFO [2023-03-21 11:06:31,902] [dw-66 - GET /api/v1/system/config/jwks] o.o.s.e.CatalogGenericExceptionMapper - exception 
openmetadata_server         | javax.ws.rs.NotFoundException: HTTP 404 Not Found
openmetadata_server         |   at org.glassfish.jersey.server.ServerRuntime$1.run(ServerRuntime.java:253)
openmetadata_server         |   at org.glassfish.jersey.internal.Errors$1.call(Errors.java:248)
openmetadata_server         |   at org.glassfish.jersey.internal.Errors$1.call(Errors.java:244)
openmetadata_server         |   at org.glassfish.jersey.internal.Errors.process(Errors.java:292)
openmetadata_server         |   at org.glassfish.jersey.internal.Errors.process(Errors.java:274)
openmetadata_server         |   at org.glassfish.jersey.internal.Errors.process(Errors.java:244)
openmetadata_server         |   at org.glassfish.jersey.process.internal.RequestScope.runInScope(RequestScope.java:265)
openmetadata_server         |   at org.glassfish.jersey.server.ServerRuntime.process(ServerRuntime.java:235)
openmetadata_server         |   at org.glassfish.jersey.server.ApplicationHandler.handle(ApplicationHandler.java:684)
openmetadata_server         |   at org.glassfish.jersey.servlet.WebComponent.serviceImpl(WebComponent.java:394)
openmetadata_server         |   at org.glassfish.jersey.servlet.WebComponent.service(WebComponent.java:346)
openmetadata_server         |   at org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:358)
openmetadata_server         |   at org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:311)
openmetadata_server         |   at org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:205)
openmetadata_server         |   at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:799)
openmetadata_server         |   at org.eclipse.jetty.servlet.ServletHandler$ChainEnd.doFilter(ServletHandler.java:1656)
openmetadata_server         |   at io.dropwizard.servlets.ThreadNameFilter.doFilter(ThreadNameFilter.java:35)
openmetadata_server         |   at org.eclipse.jetty.servlet.FilterHolder.doFilter(FilterHolder.java:193)
openmetadata_server         |   at org.eclipse.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1626)
openmetadata_server         |   at io.dropwizard.jersey.filter.AllowedMethodsFilter.handle(AllowedMethodsFilter.java:47)
openmetadata_server         |   at io.dropwizard.jersey.filter.AllowedMethodsFilter.doFilter(AllowedMethodsFilter.java:41)
openmetadata_server         |   at org.eclipse.jetty.servlet.FilterHolder.doFilter(FilterHolder.java:193)
openmetadata_server         |   at org.eclipse.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1626)
openmetadata_server         |   at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:292)
openmetadata_server         |   at org.eclipse.jetty.servlet.FilterHolder.doFilter(FilterHolder.java:193)
openmetadata_server         |   at org.eclipse.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1626)
openmetadata_server         |   at io.github.maksymdolgykh.dropwizard.micrometer.MicrometerHttpFilter.doFilter(MicrometerHttpFilter.java:28)
openmetadata_server         |   at org.eclipse.jetty.servlet.FilterHolder.doFilter(FilterHolder.java:193)
openmetadata_server         |   at org.eclipse.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1626)
openmetadata_server         |   at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:552)
openmetadata_server         |   at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233)
openmetadata_server         |   at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1440)
openmetadata_server         |   at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188)
openmetadata_server         |   at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:505)
openmetadata_server         |   at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186)
openmetadata_server         |   at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1355)
openmetadata_server         |   at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
openmetadata_server         |   at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)
openmetadata_server         |   at com.codahale.metrics.jetty9.InstrumentedHandler.handle(InstrumentedHandler.java:284)
openmetadata_server         |   at io.dropwizard.jetty.RoutingHandler.handle(RoutingHandler.java:52)
openmetadata_server         |   at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:772)
openmetadata_server         |   at io.dropwizard.jetty.ZipExceptionHandlingGzipHandler.handle(ZipExceptionHandlingGzipHandler.java:26)
openmetadata_server         |   at org.eclipse.jetty.server.handler.RequestLogHandler.handle(RequestLogHandler.java:54)
openmetadata_server         |   at org.eclipse.jetty.server.handler.StatisticsHandler.handle(StatisticsHandler.java:181)
openmetadata_server         |   at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)
openmetadata_server         |   at org.eclipse.jetty.server.Server.handle(Server.java:516)
openmetadata_server         |   at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:487)
openmetadata_server         |   at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:732)
openmetadata_server         |   at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:479)
openmetadata_server         |   at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:277)
openmetadata_server         |   at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311)
openmetadata_server         |   at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105)
openmetadata_server         |   at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104)
openmetadata_server         |   at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:338)
openmetadata_server         |   at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:315)
openmetadata_server         |   at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:173)
openmetadata_server         |   at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:131)
openmetadata_server         |   at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:409)
openmetadata_server         |   at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:883)
openmetadata_server         |   at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1034)
openmetadata_server         |   at java.base/java.lang.Thread.run(Thread.java:829)
openmetadata_server         | ERROR [2023-03-21 11:06:31,904] [dw-66 - GET /api/v1/system/config/jwks] o.o.s.e.CatalogGenericExceptionMapper - Got exception: [NotFoundException] / message [HTTP 404 Not Found]
openmetadata_server         | javax.ws.rs.NotFoundException: HTTP 404 Not Found
openmetadata_server         |   at org.glassfish.jersey.server.ServerRuntime$1.run(ServerRuntime.java:253)
openmetadata_server         |   at org.glassfish.jersey.internal.Errors$1.call(Errors.java:248)
openmetadata_server         |   at org.glassfish.jersey.internal.Errors$1.call(Errors.java:244)
openmetadata_server         |   at org.glassfish.jersey.internal.Errors.process(Errors.java:292)
openmetadata_server         |   at org.glassfish.jersey.internal.Errors.process(Errors.java:274)
openmetadata_server         |   at org.glassfish.jersey.internal.Errors.process(Errors.java:244)
openmetadata_server         |   at org.glassfish.jersey.process.internal.RequestScope.runInScope(RequestScope.java:265)
openmetadata_server         |   at org.glassfish.jersey.server.ServerRuntime.process(ServerRuntime.java:235)
openmetadata_server         |   at org.glassfish.jersey.server.ApplicationHandler.handle(ApplicationHandler.java:684)
openmetadata_server         |   at org.glassfish.jersey.servlet.WebComponent.serviceImpl(WebComponent.java:394)
openmetadata_server         |   at org.glassfish.jersey.servlet.WebComponent.service(WebComponent.java:346)
openmetadata_server         |   at org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:358)
openmetadata_server         |   at org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:311)
openmetadata_server         |   at org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:205)
openmetadata_server         |   at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:799)
openmetadata_server         |   at org.eclipse.jetty.servlet.ServletHandler$ChainEnd.doFilter(ServletHandler.java:1656)
openmetadata_server         |   at io.dropwizard.servlets.ThreadNameFilter.doFilter(ThreadNameFilter.java:35)
openmetadata_server         |   at org.eclipse.jetty.servlet.FilterHolder.doFilter(FilterHolder.java:193)
openmetadata_server         |   at org.eclipse.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1626)
openmetadata_server         |   at io.dropwizard.jersey.filter.AllowedMethodsFilter.handle(AllowedMethodsFilter.java:47)
openmetadata_server         |   at io.dropwizard.jersey.filter.AllowedMethodsFilter.doFilter(AllowedMethodsFilter.java:41)
openmetadata_server         |   at org.eclipse.jetty.servlet.FilterHolder.doFilter(FilterHolder.java:193)
openmetadata_server         |   at org.eclipse.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1626)
openmetadata_server         |   at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:292)
openmetadata_server         |   at org.eclipse.jetty.servlet.FilterHolder.doFilter(FilterHolder.java:193)
openmetadata_server         |   at org.eclipse.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1626)
openmetadata_server         |   at io.github.maksymdolgykh.dropwizard.micrometer.MicrometerHttpFilter.doFilter(MicrometerHttpFilter.java:28)
openmetadata_server         |   at org.eclipse.jetty.servlet.FilterHolder.doFilter(FilterHolder.java:193)
openmetadata_server         |   at org.eclipse.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1626)
openmetadata_server         |   at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:552)
openmetadata_server         |   at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233)
openmetadata_server         |   at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1440)
openmetadata_server         |   at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188)
openmetadata_server         |   at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:505)
openmetadata_server         |   at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186)
openmetadata_server         |   at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1355)
openmetadata_server         |   at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
openmetadata_server         |   at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)
openmetadata_server         |   at com.codahale.metrics.jetty9.InstrumentedHandler.handle(InstrumentedHandler.java:284)
openmetadata_server         |   at io.dropwizard.jetty.RoutingHandler.handle(RoutingHandler.java:52)
openmetadata_server         |   at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:772)
openmetadata_server         |   at io.dropwizard.jetty.ZipExceptionHandlingGzipHandler.handle(ZipExceptionHandlingGzipHandler.java:26)
openmetadata_server         |   at org.eclipse.jetty.server.handler.RequestLogHandler.handle(RequestLogHandler.java:54)
openmetadata_server         |   at org.eclipse.jetty.server.handler.StatisticsHandler.handle(StatisticsHandler.java:181)
openmetadata_server         |   at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)
openmetadata_server         |   at org.eclipse.jetty.server.Server.handle(Server.java:516)
openmetadata_server         |   at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:487)
openmetadata_server         |   at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:732)
openmetadata_server         |   at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:479)
openmetadata_server         |   at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:277)
openmetadata_server         |   at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311)
openmetadata_server         |   at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105)
openmetadata_server         |   at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104)
openmetadata_server         |   at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:338)
openmetadata_server         |   at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:315)
openmetadata_server         |   at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:173)
openmetadata_server         |   at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:131)
openmetadata_server         |   at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:409)
openmetadata_server         |   at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:883)
openmetadata_server         |   at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1034)
openmetadata_server         |   at java.base/java.lang.Thread.run(Thread.java:829)
openmetadata_server         | 127.0.0.1 - - [21/Mar/2023:11:06:31 +0000] "GET /api/v1/system/config/jwks HTTP/1.1" 500 105 "-" "Java/11.0.18" 5
openmetadata_server         | INFO [2023-03-21 11:06:31,905] [dw-48 - GET /api/v1/services/storageServices/name/sample_s3] o.o.s.e.CatalogGenericExceptionMapper - exception 
openmetadata_server         | com.auth0.jwk.SigningKeyNotFoundException: No key found in with kid Gb389a-9f76-gdjs-a92j-0242bk94356
openmetadata_server         |   at org.openmetadata.service.security.MultiUrlJwkProvider.get(MultiUrlJwkProvider.java:34)
openmetadata_server         |   at org.openmetadata.service.security.JwtFilter.validateAndReturnDecodedJwtToken(JwtFilter.java:163)
openmetadata_server         |   at org.openmetadata.service.security.JwtFilter.filter(JwtFilter.java:124)
openmetadata_server         |   at org.glassfish.jersey.server.ContainerFilteringStage.apply(ContainerFilteringStage.java:108)
openmetadata_server         |   at org.glassfish.jersey.server.ContainerFilteringStage.apply(ContainerFilteringStage.java:44)
openmetadata_server         |   at org.glassfish.jersey.process.internal.Stages.process(Stages.java:173)
openmetadata_server         |   at org.glassfish.jersey.server.ServerRuntime$1.run(ServerRuntime.java:248)
openmetadata_server         |   at org.glassfish.jersey.internal.Errors$1.call(Errors.java:248)
openmetadata_server         |   at org.glassfish.jersey.internal.Errors$1.call(Errors.java:244)
openmetadata_server         |   at org.glassfish.jersey.internal.Errors.process(Errors.java:292)
openmetadata_server         |   at org.glassfish.jersey.internal.Errors.process(Errors.java:274)
openmetadata_server         |   at org.glassfish.jersey.internal.Errors.process(Errors.java:244)
openmetadata_server         |   at org.glassfish.jersey.process.internal.RequestScope.runInScope(RequestScope.java:265)
openmetadata_server         |   at org.glassfish.jersey.server.ServerRuntime.process(ServerRuntime.java:235)
openmetadata_server         |   at org.glassfish.jersey.server.ApplicationHandler.handle(ApplicationHandler.java:684)
openmetadata_server         |   at org.glassfish.jersey.servlet.WebComponent.serviceImpl(WebComponent.java:394)
openmetadata_server         |   at org.glassfish.jersey.servlet.WebComponent.service(WebComponent.java:346)
openmetadata_server         |   at org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:358)
openmetadata_server         |   at org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:311)
openmetadata_server         |   at org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:205)
openmetadata_server         |   at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:799)
openmetadata_server         |   at org.eclipse.jetty.servlet.ServletHandler$ChainEnd.doFilter(ServletHandler.java:1656)
openmetadata_server         |   at io.dropwizard.servlets.ThreadNameFilter.doFilter(ThreadNameFilter.java:35)
openmetadata_server         |   at org.eclipse.jetty.servlet.FilterHolder.doFilter(FilterHolder.java:193)
openmetadata_server         |   at org.eclipse.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1626)
openmetadata_server         |   at io.dropwizard.jersey.filter.AllowedMethodsFilter.handle(AllowedMethodsFilter.java:47)
openmetadata_server         |   at io.dropwizard.jersey.filter.AllowedMethodsFilter.doFilter(AllowedMethodsFilter.java:41)
openmetadata_server         |   at org.eclipse.jetty.servlet.FilterHolder.doFilter(FilterHolder.java:193)
openmetadata_server         |   at org.eclipse.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1626)
openmetadata_server         |   at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:292)
openmetadata_server         |   at org.eclipse.jetty.servlet.FilterHolder.doFilter(FilterHolder.java:193)
openmetadata_server         |   at org.eclipse.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1626)
openmetadata_server         |   at io.github.maksymdolgykh.dropwizard.micrometer.MicrometerHttpFilter.doFilter(MicrometerHttpFilter.java:28)
openmetadata_server         |   at org.eclipse.jetty.servlet.FilterHolder.doFilter(FilterHolder.java:193)
openmetadata_server         |   at org.eclipse.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1626)
openmetadata_server         |   at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:552)
openmetadata_server         |   at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233)
openmetadata_server         |   at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1440)
openmetadata_server         |   at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188)
openmetadata_server         |   at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:505)
openmetadata_server         |   at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186)
openmetadata_server         |   at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1355)
openmetadata_server         |   at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
openmetadata_server         |   at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)
openmetadata_server         |   at com.codahale.metrics.jetty9.InstrumentedHandler.handle(InstrumentedHandler.java:284)
openmetadata_server         |   at io.dropwizard.jetty.RoutingHandler.handle(RoutingHandler.java:52)
openmetadata_server         |   at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:772)
openmetadata_server         |   at io.dropwizard.jetty.ZipExceptionHandlingGzipHandler.handle(ZipExceptionHandlingGzipHandler.java:26)
openmetadata_server         |   at org.eclipse.jetty.server.handler.RequestLogHandler.handle(RequestLogHandler.java:54)
openmetadata_server         |   at org.eclipse.jetty.server.handler.StatisticsHandler.handle(StatisticsHandler.java:181)
openmetadata_server         |   at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)
openmetadata_server         |   at org.eclipse.jetty.server.Server.handle(Server.java:516)
openmetadata_server         |   at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:487)
openmetadata_server         |   at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:732)
openmetadata_server         |   at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:479)
openmetadata_server         |   at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:277)
openmetadata_server         |   at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311)
openmetadata_server         |   at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105)
openmetadata_server         |   at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104)
openmetadata_server         |   at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:338)
openmetadata_server         |   at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:315)
openmetadata_server         |   at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:173)
openmetadata_server         |   at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:131)
openmetadata_server         |   at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:409)
openmetadata_server         |   at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:883)
openmetadata_server         |   at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1034)
openmetadata_server         |   at java.base/java.lang.Thread.run(Thread.java:829)
openmetadata_server         |   Suppressed: com.auth0.jwk.NetworkException: Cannot obtain jwks from url http://localhost:8585/api/v1/system/config/jwks
openmetadata_server         |       at com.auth0.jwk.UrlJwkProvider.getJwks(UrlJwkProvider.java:139)
openmetadata_server         |       at com.auth0.jwk.UrlJwkProvider.getAll(UrlJwkProvider.java:145)
openmetadata_server         |       at com.auth0.jwk.UrlJwkProvider.get(UrlJwkProvider.java:163)
openmetadata_server         |       at org.openmetadata.service.security.MultiUrlJwkProvider.get(MultiUrlJwkProvider.java:37)
openmetadata_server         |       ... 66 common frames omitted
openmetadata_server         |   Caused by: java.io.IOException: Server returned HTTP response code: 500 for URL: http://localhost:8585/api/v1/system/config/jwks
openmetadata_server         |       at java.base/sun.net.www.protocol.http.HttpURLConnection.getInputStream0(HttpURLConnection.java:1924)
openmetadata_server         |       at java.base/sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1520)
openmetadata_server         |       at com.auth0.jwk.UrlJwkProvider.getJwks(UrlJwkProvider.java:135)
openmetadata_server         |       ... 69 common frames omitted
openmetadata_server         | ERROR [2023-03-21 11:06:31,906] [dw-48 - GET /api/v1/services/storageServices/name/sample_s3] o.o.s.e.CatalogGenericExceptionMapper - Got exception: [SigningKeyNotFoundException] / message [No key found in with kid Gb389a-9f76-gdjs-a92j-0242bk94356]
openmetadata_server         | com.auth0.jwk.SigningKeyNotFoundException: No key found in with kid Gb389a-9f76-gdjs-a92j-0242bk94356
openmetadata_server         |   at org.openmetadata.service.security.MultiUrlJwkProvider.get(MultiUrlJwkProvider.java:34)
openmetadata_server         |   at org.openmetadata.service.security.JwtFilter.validateAndReturnDecodedJwtToken(JwtFilter.java:163)
openmetadata_server         |   at org.openmetadata.service.security.JwtFilter.filter(JwtFilter.java:124)
openmetadata_server         |   at org.glassfish.jersey.server.ContainerFilteringStage.apply(ContainerFilteringStage.java:108)
openmetadata_server         |   at org.glassfish.jersey.server.ContainerFilteringStage.apply(ContainerFilteringStage.java:44)
openmetadata_server         |   at org.glassfish.jersey.process.internal.Stages.process(Stages.java:173)
openmetadata_server         |   at org.glassfish.jersey.server.ServerRuntime$1.run(ServerRuntime.java:248)
openmetadata_server         |   at org.glassfish.jersey.internal.Errors$1.call(Errors.java:248)
openmetadata_server         |   at org.glassfish.jersey.internal.Errors$1.call(Errors.java:244)
openmetadata_server         |   at org.glassfish.jersey.internal.Errors.process(Errors.java:292)
openmetadata_server         |   at org.glassfish.jersey.internal.Errors.process(Errors.java:274)
openmetadata_server         |   at org.glassfish.jersey.internal.Errors.process(Errors.java:244)
openmetadata_server         |   at org.glassfish.jersey.process.internal.RequestScope.runInScope(RequestScope.java:265)
openmetadata_server         |   at org.glassfish.jersey.server.ServerRuntime.process(ServerRuntime.java:235)
openmetadata_server         |   at org.glassfish.jersey.server.ApplicationHandler.handle(ApplicationHandler.java:684)
openmetadata_server         |   at org.glassfish.jersey.servlet.WebComponent.serviceImpl(WebComponent.java:394)
openmetadata_server         |   at org.glassfish.jersey.servlet.WebComponent.service(WebComponent.java:346)
openmetadata_server         |   at org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:358)
openmetadata_server         |   at org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:311)
openmetadata_server         |   at org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:205)
openmetadata_server         |   at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:799)
openmetadata_server         |   at org.eclipse.jetty.servlet.ServletHandler$ChainEnd.doFilter(ServletHandler.java:1656)
openmetadata_server         |   at io.dropwizard.servlets.ThreadNameFilter.doFilter(ThreadNameFilter.java:35)
openmetadata_server         |   at org.eclipse.jetty.servlet.FilterHolder.doFilter(FilterHolder.java:193)
openmetadata_server         |   at org.eclipse.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1626)
openmetadata_server         |   at io.dropwizard.jersey.filter.AllowedMethodsFilter.handle(AllowedMethodsFilter.java:47)
openmetadata_server         |   at io.dropwizard.jersey.filter.AllowedMethodsFilter.doFilter(AllowedMethodsFilter.java:41)
openmetadata_server         |   at org.eclipse.jetty.servlet.FilterHolder.doFilter(FilterHolder.java:193)
openmetadata_server         |   at org.eclipse.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1626)
openmetadata_server         |   at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:292)
openmetadata_server         |   at org.eclipse.jetty.servlet.FilterHolder.doFilter(FilterHolder.java:193)
openmetadata_server         |   at org.eclipse.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1626)
openmetadata_server         |   at io.github.maksymdolgykh.dropwizard.micrometer.MicrometerHttpFilter.doFilter(MicrometerHttpFilter.java:28)
openmetadata_server         |   at org.eclipse.jetty.servlet.FilterHolder.doFilter(FilterHolder.java:193)
openmetadata_server         |   at org.eclipse.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1626)
openmetadata_server         |   at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:552)
openmetadata_server         |   at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233)
openmetadata_server         |   at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1440)
openmetadata_server         |   at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188)
openmetadata_server         |   at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:505)
openmetadata_server         |   at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186)
openmetadata_server         |   at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1355)
openmetadata_server         |   at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
openmetadata_server         |   at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)
openmetadata_server         |   at com.codahale.metrics.jetty9.InstrumentedHandler.handle(InstrumentedHandler.java:284)
openmetadata_server         |   at io.dropwizard.jetty.RoutingHandler.handle(RoutingHandler.java:52)
openmetadata_server         |   at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:772)
openmetadata_server         |   at io.dropwizard.jetty.ZipExceptionHandlingGzipHandler.handle(ZipExceptionHandlingGzipHandler.java:26)
openmetadata_server         |   at org.eclipse.jetty.server.handler.RequestLogHandler.handle(RequestLogHandler.java:54)
openmetadata_server         |   at org.eclipse.jetty.server.handler.StatisticsHandler.handle(StatisticsHandler.java:181)
openmetadata_server         |   at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)
openmetadata_server         |   at org.eclipse.jetty.server.Server.handle(Server.java:516)
openmetadata_server         |   at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:487)
openmetadata_server         |   at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:732)
openmetadata_server         |   at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:479)
openmetadata_server         |   at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:277)
openmetadata_server         |   at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311)
openmetadata_server         |   at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105)
openmetadata_server         |   at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104)
openmetadata_server         |   at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:338)
openmetadata_server         |   at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:315)
openmetadata_server         |   at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:173)
openmetadata_server         |   at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:131)
openmetadata_server         |   at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:409)
openmetadata_server         |   at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:883)
openmetadata_server         |   at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1034)
openmetadata_server         |   at java.base/java.lang.Thread.run(Thread.java:829)
openmetadata_server         |   Suppressed: com.auth0.jwk.NetworkException: Cannot obtain jwks from url http://localhost:8585/api/v1/system/config/jwks
openmetadata_server         |       at com.auth0.jwk.UrlJwkProvider.getJwks(UrlJwkProvider.java:139)
openmetadata_server         |       at com.auth0.jwk.UrlJwkProvider.getAll(UrlJwkProvider.java:145)
openmetadata_server         |       at com.auth0.jwk.UrlJwkProvider.get(UrlJwkProvider.java:163)
openmetadata_server         |       at org.openmetadata.service.security.MultiUrlJwkProvider.get(MultiUrlJwkProvider.java:37)
openmetadata_server         |       ... 66 common frames omitted
openmetadata_server         |   Caused by: java.io.IOException: Server returned HTTP response code: 500 for URL: http://localhost:8585/api/v1/system/config/jwks
openmetadata_server         |       at java.base/sun.net.www.protocol.http.HttpURLConnection.getInputStream0(HttpURLConnection.java:1924)
openmetadata_server         |       at java.base/sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1520)
openmetadata_server         |       at com.auth0.jwk.UrlJwkProvider.getJwks(UrlJwkProvider.java:135)
openmetadata_server         |       ... 69 common frames omitted
openmetadata_server         | 172.16.240.5 - - [21/Mar/2023:11:06:31 +0000] "GET /api/v1/services/storageServices/name/sample_s3 HTTP/1.1" 500 145 "-" "python-requests/2.28.0" 15
openmetadata_postgresql     | 2023-03-21 11:06:32.116 UTC [915] LOG:  unexpected EOF on client connection with an open transaction
openmetadata_ingestion      | [2023-03-21 11:06:32,348] {scheduler_job.py:599} INFO - Executor reports execution of sample_data.ingest_using_recipe run_id=manual__2023-03-21T11:06:29.605847+00:00 exited with status success for try_number 1
openmetadata_ingestion      | [2023-03-21 11:06:32,351] {scheduler_job.py:642} INFO - TaskInstance Finished: dag_id=sample_data, task_id=ingest_using_recipe, run_id=manual__2023-03-21T11:06:29.605847+00:00, map_index=-1, run_start_date=2023-03-21 11:06:31.610120+00:00, run_end_date=2023-03-21 11:06:31.933395+00:00, run_duration=0.323275, state=up_for_retry, executor_state=success, try_number=1, max_tries=3, job_id=17, pool=default_pool, queue=default, priority_weight=1, operator=PythonOperator, queued_dttm=2023-03-21 11:06:29.803009+00:00, queued_by_job_id=12, pid=1198
openmetadata_ingestion      | [2023-03-21 11:06:42,420] {scheduler_job.py:353} INFO - 1 tasks up for execution:
openmetadata_ingestion      |   <TaskInstance: sample_data.ingest_using_recipe manual__2023-03-21T11:06:29.605847+00:00 [scheduled]>
openmetadata_ingestion      | [2023-03-21 11:06:42,420] {scheduler_job.py:418} INFO - DAG sample_data has 0/16 running and queued tasks
openmetadata_ingestion      | [2023-03-21 11:06:42,420] {scheduler_job.py:504} INFO - Setting the following tasks to queued state:
openmetadata_ingestion      |   <TaskInstance: sample_data.ingest_using_recipe manual__2023-03-21T11:06:29.605847+00:00 [scheduled]>
openmetadata_ingestion      | [2023-03-21 11:06:42,421] {scheduler_job.py:546} INFO - Sending TaskInstanceKey(dag_id='sample_data', task_id='ingest_using_recipe', run_id='manual__2023-03-21T11:06:29.605847+00:00', try_number=2, map_index=-1) to executor with priority 1 and queue default
openmetadata_ingestion      | [2023-03-21 11:06:42,421] {base_executor.py:91} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sample_data', 'ingest_using_recipe', 'manual__2023-03-21T11:06:29.605847+00:00', '--local', '--subdir', 'DAGS_FOLDER/airflow_sample_data.py']
openmetadata_ingestion      | [2023-03-21 11:06:42,425] {local_executor.py:79} INFO - QueuedLocalWorker running ['airflow', 'tasks', 'run', 'sample_data', 'ingest_using_recipe', 'manual__2023-03-21T11:06:29.605847+00:00', '--local', '--subdir', 'DAGS_FOLDER/airflow_sample_data.py']
openmetadata_ingestion      | [2023-03-21 11:06:42,465] {dagbag.py:508} INFO - Filling up the DagBag from /opt/airflow/dags/airflow_sample_data.py
openmetadata_ingestion      | [2023-03-21 11:06:43,899] {task_command.py:371} INFO - Running <TaskInstance: sample_data.ingest_using_recipe manual__2023-03-21T11:06:29.605847+00:00 [queued]> on host 2b39d8e79b0b
openmetadata_server         | 172.16.240.5 - - [21/Mar/2023:11:06:44 +0000] "GET /api/v1/version HTTP/1.1" 200 100 "-" "python-requests/2.28.0" 4
openmetadata_server         | 172.16.240.5 - - [21/Mar/2023:11:06:44 +0000] "GET /api/v1/version HTTP/1.1" 200 100 "-" "python-requests/2.28.0" 2
openmetadata_server         | 172.16.240.5 - - [21/Mar/2023:11:06:44 +0000] "GET /api/v1/version HTTP/1.1" 200 100 "-" "python-requests/2.28.0" 1
openmetadata_server         | INFO [2023-03-21 11:06:44,290] [dw-52 - GET /api/v1/system/config/jwks] o.o.s.e.CatalogGenericExceptionMapper - exception 
openmetadata_server         | javax.ws.rs.NotFoundException: HTTP 404 Not Found
openmetadata_server         |   at org.glassfish.jersey.server.ServerRuntime$1.run(ServerRuntime.java:253)
openmetadata_server         |   at org.glassfish.jersey.internal.Errors$1.call(Errors.java:248)
openmetadata_server         |   at org.glassfish.jersey.internal.Errors$1.call(Errors.java:244)
openmetadata_server         |   at org.glassfish.jersey.internal.Errors.process(Errors.java:292)
openmetadata_server         |   at org.glassfish.jersey.internal.Errors.process(Errors.java:274)
openmetadata_server         |   at org.glassfish.jersey.internal.Errors.process(Errors.java:244)
openmetadata_server         |   at org.glassfish.jersey.process.internal.RequestScope.runInScope(RequestScope.java:265)
openmetadata_server         |   at org.glassfish.jersey.server.ServerRuntime.process(ServerRuntime.java:235)
openmetadata_server         |   at org.glassfish.jersey.server.ApplicationHandler.handle(ApplicationHandler.java:684)
openmetadata_server         |   at org.glassfish.jersey.servlet.WebComponent.serviceImpl(WebComponent.java:394)
openmetadata_server         |   at org.glassfish.jersey.servlet.WebComponent.service(WebComponent.java:346)
openmetadata_server         |   at org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:358)
openmetadata_server         |   at org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:311)
openmetadata_server         |   at org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:205)
openmetadata_server         |   at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:799)
openmetadata_server         |   at org.eclipse.jetty.servlet.ServletHandler$ChainEnd.doFilter(ServletHandler.java:1656)
openmetadata_server         |   at io.dropwizard.servlets.ThreadNameFilter.doFilter(ThreadNameFilter.java:35)
openmetadata_server         |   at org.eclipse.jetty.servlet.FilterHolder.doFilter(FilterHolder.java:193)
openmetadata_server         |   at org.eclipse.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1626)
openmetadata_server         |   at io.dropwizard.jersey.filter.AllowedMethodsFilter.handle(AllowedMethodsFilter.java:47)
openmetadata_server         |   at io.dropwizard.jersey.filter.AllowedMethodsFilter.doFilter(AllowedMethodsFilter.java:41)
openmetadata_server         |   at org.eclipse.jetty.servlet.FilterHolder.doFilter(FilterHolder.java:193)
openmetadata_server         |   at org.eclipse.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1626)
openmetadata_server         |   at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:292)
openmetadata_server         |   at org.eclipse.jetty.servlet.FilterHolder.doFilter(FilterHolder.java:193)
openmetadata_server         |   at org.eclipse.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1626)
openmetadata_server         |   at io.github.maksymdolgykh.dropwizard.micrometer.MicrometerHttpFilter.doFilter(MicrometerHttpFilter.java:28)
openmetadata_server         |   at org.eclipse.jetty.servlet.FilterHolder.doFilter(FilterHolder.java:193)
openmetadata_server         |   at org.eclipse.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1626)
openmetadata_server         |   at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:552)
openmetadata_server         |   at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233)
openmetadata_server         |   at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1440)
openmetadata_server         |   at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188)
openmetadata_server         |   at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:505)
openmetadata_server         |   at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186)
openmetadata_server         |   at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1355)
openmetadata_server         |   at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
openmetadata_server         |   at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)
openmetadata_server         |   at com.codahale.metrics.jetty9.InstrumentedHandler.handle(InstrumentedHandler.java:284)
openmetadata_server         |   at io.dropwizard.jetty.RoutingHandler.handle(RoutingHandler.java:52)
openmetadata_server         |   at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:772)
openmetadata_server         |   at io.dropwizard.jetty.ZipExceptionHandlingGzipHandler.handle(ZipExceptionHandlingGzipHandler.java:26)
openmetadata_server         |   at org.eclipse.jetty.server.handler.RequestLogHandler.handle(RequestLogHandler.java:54)
openmetadata_server         |   at org.eclipse.jetty.server.handler.StatisticsHandler.handle(StatisticsHandler.java:181)
openmetadata_server         |   at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)
openmetadata_server         |   at org.eclipse.jetty.server.Server.handle(Server.java:516)
openmetadata_server         |   at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:487)
openmetadata_server         |   at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:732)
openmetadata_server         |   at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:479)
openmetadata_server         |   at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:277)
openmetadata_server         |   at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311)
openmetadata_server         |   at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105)
openmetadata_server         |   at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104)
openmetadata_server         |   at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:338)
openmetadata_server         |   at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:315)
openmetadata_server         |   at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:173)
openmetadata_server         |   at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:131)
openmetadata_server         |   at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:409)
openmetadata_server         |   at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:883)
openmetadata_server         |   at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1034)
openmetadata_server         |   at java.base/java.lang.Thread.run(Thread.java:829)
openmetadata_server         | ERROR [2023-03-21 11:06:44,290] [dw-52 - GET /api/v1/system/config/jwks] o.o.s.e.CatalogGenericExceptionMapper - Got exception: [NotFoundException] / message [HTTP 404 Not Found]
openmetadata_server         | javax.ws.rs.NotFoundException: HTTP 404 Not Found
openmetadata_server         |   at org.glassfish.jersey.server.ServerRuntime$1.run(ServerRuntime.java:253)
openmetadata_server         |   at org.glassfish.jersey.internal.Errors$1.call(Errors.java:248)
openmetadata_server         |   at org.glassfish.jersey.internal.Errors$1.call(Errors.java:244)
openmetadata_server         |   at org.glassfish.jersey.internal.Errors.process(Errors.java:292)
openmetadata_server         |   at org.glassfish.jersey.internal.Errors.process(Errors.java:274)
openmetadata_server         |   at org.glassfish.jersey.internal.Errors.process(Errors.java:244)
openmetadata_server         |   at org.glassfish.jersey.process.internal.RequestScope.runInScope(RequestScope.java:265)
openmetadata_server         |   at org.glassfish.jersey.server.ServerRuntime.process(ServerRuntime.java:235)
openmetadata_server         |   at org.glassfish.jersey.server.ApplicationHandler.handle(ApplicationHandler.java:684)
openmetadata_server         |   at org.glassfish.jersey.servlet.WebComponent.serviceImpl(WebComponent.java:394)
openmetadata_server         |   at org.glassfish.jersey.servlet.WebComponent.service(WebComponent.java:346)
openmetadata_server         |   at org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:358)
openmetadata_server         |   at org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:311)
openmetadata_server         |   at org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:205)
openmetadata_server         |   at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:799)
openmetadata_server         |   at org.eclipse.jetty.servlet.ServletHandler$ChainEnd.doFilter(ServletHandler.java:1656)
openmetadata_server         |   at io.dropwizard.servlets.ThreadNameFilter.doFilter(ThreadNameFilter.java:35)
openmetadata_server         |   at org.eclipse.jetty.servlet.FilterHolder.doFilter(FilterHolder.java:193)
openmetadata_server         |   at org.eclipse.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1626)
openmetadata_server         |   at io.dropwizard.jersey.filter.AllowedMethodsFilter.handle(AllowedMethodsFilter.java:47)
openmetadata_server         |   at io.dropwizard.jersey.filter.AllowedMethodsFilter.doFilter(AllowedMethodsFilter.java:41)
openmetadata_server         |   at org.eclipse.jetty.servlet.FilterHolder.doFilter(FilterHolder.java:193)
openmetadata_server         |   at org.eclipse.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1626)
openmetadata_server         |   at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:292)
openmetadata_server         |   at org.eclipse.jetty.servlet.FilterHolder.doFilter(FilterHolder.java:193)
openmetadata_server         |   at org.eclipse.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1626)
openmetadata_server         |   at io.github.maksymdolgykh.dropwizard.micrometer.MicrometerHttpFilter.doFilter(MicrometerHttpFilter.java:28)
openmetadata_server         |   at org.eclipse.jetty.servlet.FilterHolder.doFilter(FilterHolder.java:193)
openmetadata_server         |   at org.eclipse.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1626)
openmetadata_server         |   at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:552)
openmetadata_server         |   at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233)
openmetadata_server         |   at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1440)
openmetadata_server         |   at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188)
openmetadata_server         |   at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:505)
openmetadata_server         |   at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186)
openmetadata_server         |   at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1355)
openmetadata_server         |   at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
openmetadata_server         |   at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)
openmetadata_server         |   at com.codahale.metrics.jetty9.InstrumentedHandler.handle(InstrumentedHandler.java:284)
openmetadata_server         |   at io.dropwizard.jetty.RoutingHandler.handle(RoutingHandler.java:52)
openmetadata_server         |   at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:772)
openmetadata_server         |   at io.dropwizard.jetty.ZipExceptionHandlingGzipHandler.handle(ZipExceptionHandlingGzipHandler.java:26)
openmetadata_server         |   at org.eclipse.jetty.server.handler.RequestLogHandler.handle(RequestLogHandler.java:54)
openmetadata_server         |   at org.eclipse.jetty.server.handler.StatisticsHandler.handle(StatisticsHandler.java:181)
openmetadata_server         |   at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)
openmetadata_server         |   at org.eclipse.jetty.server.Server.handle(Server.java:516)
openmetadata_server         |   at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:487)
openmetadata_server         |   at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:732)
openmetadata_server         |   at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:479)
openmetadata_server         |   at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:277)
openmetadata_server         |   at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311)
openmetadata_server         |   at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105)
openmetadata_server         |   at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104)
openmetadata_server         |   at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:338)
openmetadata_server         |   at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:315)
openmetadata_server         |   at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:173)
openmetadata_server         |   at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:131)
openmetadata_server         |   at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:409)
openmetadata_server         |   at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:883)
openmetadata_server         |   at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1034)
openmetadata_server         |   at java.base/java.lang.Thread.run(Thread.java:829)
openmetadata_server         | 127.0.0.1 - - [21/Mar/2023:11:06:44 +0000] "GET /api/v1/system/config/jwks HTTP/1.1" 500 105 "-" "Java/11.0.18" 1
openmetadata_server         | INFO [2023-03-21 11:06:44,291] [dw-48 - GET /api/v1/services/storageServices/name/sample_s3] o.o.s.e.CatalogGenericExceptionMapper - exception 
openmetadata_server         | com.auth0.jwk.SigningKeyNotFoundException: No key found in with kid Gb389a-9f76-gdjs-a92j-0242bk94356
openmetadata_server         |   at org.openmetadata.service.security.MultiUrlJwkProvider.get(MultiUrlJwkProvider.java:34)
openmetadata_server         |   at org.openmetadata.service.security.JwtFilter.validateAndReturnDecodedJwtToken(JwtFilter.java:163)
openmetadata_server         |   at org.openmetadata.service.security.JwtFilter.filter(JwtFilter.java:124)
openmetadata_server         |   at org.glassfish.jersey.server.ContainerFilteringStage.apply(ContainerFilteringStage.java:108)
openmetadata_server         |   at org.glassfish.jersey.server.ContainerFilteringStage.apply(ContainerFilteringStage.java:44)
openmetadata_server         |   at org.glassfish.jersey.process.internal.Stages.process(Stages.java:173)
openmetadata_server         |   at org.glassfish.jersey.server.ServerRuntime$1.run(ServerRuntime.java:248)
openmetadata_server         |   at org.glassfish.jersey.internal.Errors$1.call(Errors.java:248)
openmetadata_server         |   at org.glassfish.jersey.internal.Errors$1.call(Errors.java:244)
openmetadata_server         |   at org.glassfish.jersey.internal.Errors.process(Errors.java:292)
openmetadata_server         |   at org.glassfish.jersey.internal.Errors.process(Errors.java:274)
openmetadata_server         |   at org.glassfish.jersey.internal.Errors.process(Errors.java:244)
openmetadata_server         |   at org.glassfish.jersey.process.internal.RequestScope.runInScope(RequestScope.java:265)
openmetadata_server         |   at org.glassfish.jersey.server.ServerRuntime.process(ServerRuntime.java:235)
openmetadata_server         |   at org.glassfish.jersey.server.ApplicationHandler.handle(ApplicationHandler.java:684)
openmetadata_server         |   at org.glassfish.jersey.servlet.WebComponent.serviceImpl(WebComponent.java:394)
openmetadata_server         |   at org.glassfish.jersey.servlet.WebComponent.service(WebComponent.java:346)
openmetadata_server         |   at org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:358)
openmetadata_server         |   at org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:311)
openmetadata_server         |   at org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:205)
openmetadata_server         |   at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:799)
openmetadata_server         |   at org.eclipse.jetty.servlet.ServletHandler$ChainEnd.doFilter(ServletHandler.java:1656)
openmetadata_server         |   at io.dropwizard.servlets.ThreadNameFilter.doFilter(ThreadNameFilter.java:35)
openmetadata_server         |   at org.eclipse.jetty.servlet.FilterHolder.doFilter(FilterHolder.java:193)
openmetadata_server         |   at org.eclipse.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1626)
openmetadata_server         |   at io.dropwizard.jersey.filter.AllowedMethodsFilter.handle(AllowedMethodsFilter.java:47)
openmetadata_server         |   at io.dropwizard.jersey.filter.AllowedMethodsFilter.doFilter(AllowedMethodsFilter.java:41)
openmetadata_server         |   at org.eclipse.jetty.servlet.FilterHolder.doFilter(FilterHolder.java:193)
openmetadata_server         |   at org.eclipse.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1626)
openmetadata_server         |   at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:292)
openmetadata_server         |   at org.eclipse.jetty.servlet.FilterHolder.doFilter(FilterHolder.java:193)
openmetadata_server         |   at org.eclipse.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1626)
openmetadata_server         |   at io.github.maksymdolgykh.dropwizard.micrometer.MicrometerHttpFilter.doFilter(MicrometerHttpFilter.java:28)
openmetadata_server         |   at org.eclipse.jetty.servlet.FilterHolder.doFilter(FilterHolder.java:193)
openmetadata_server         |   at org.eclipse.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1626)
openmetadata_server         |   at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:552)
openmetadata_server         |   at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233)
openmetadata_server         |   at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1440)
openmetadata_server         |   at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188)
openmetadata_server         |   at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:505)
openmetadata_server         |   at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186)
openmetadata_server         |   at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1355)
openmetadata_server         |   at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
openmetadata_server         |   at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)
openmetadata_server         |   at com.codahale.metrics.jetty9.InstrumentedHandler.handle(InstrumentedHandler.java:284)
openmetadata_server         |   at io.dropwizard.jetty.RoutingHandler.handle(RoutingHandler.java:52)
openmetadata_server         |   at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:772)
openmetadata_server         |   at io.dropwizard.jetty.ZipExceptionHandlingGzipHandler.handle(ZipExceptionHandlingGzipHandler.java:26)
openmetadata_server         |   at org.eclipse.jetty.server.handler.RequestLogHandler.handle(RequestLogHandler.java:54)
openmetadata_server         |   at org.eclipse.jetty.server.handler.StatisticsHandler.handle(StatisticsHandler.java:181)
openmetadata_server         |   at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)
openmetadata_server         |   at org.eclipse.jetty.server.Server.handle(Server.java:516)
openmetadata_server         |   at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:487)
openmetadata_server         |   at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:732)
openmetadata_server         |   at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:479)
openmetadata_server         |   at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:277)
openmetadata_server         |   at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311)
openmetadata_server         |   at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105)
openmetadata_server         |   at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104)
openmetadata_server         |   at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:338)
openmetadata_server         |   at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:315)
openmetadata_server         |   at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:173)
openmetadata_server         |   at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:131)
openmetadata_server         |   at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:409)
openmetadata_server         |   at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:883)
openmetadata_server         |   at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1034)
openmetadata_server         |   at java.base/java.lang.Thread.run(Thread.java:829)
openmetadata_server         |   Suppressed: com.auth0.jwk.NetworkException: Cannot obtain jwks from url http://localhost:8585/api/v1/system/config/jwks
openmetadata_server         |       at com.auth0.jwk.UrlJwkProvider.getJwks(UrlJwkProvider.java:139)
openmetadata_server         |       at com.auth0.jwk.UrlJwkProvider.getAll(UrlJwkProvider.java:145)
openmetadata_server         |       at com.auth0.jwk.UrlJwkProvider.get(UrlJwkProvider.java:163)
openmetadata_server         |       at org.openmetadata.service.security.MultiUrlJwkProvider.get(MultiUrlJwkProvider.java:37)
openmetadata_server         |       ... 66 common frames omitted
openmetadata_server         |   Caused by: java.io.IOException: Server returned HTTP response code: 500 for URL: http://localhost:8585/api/v1/system/config/jwks
openmetadata_server         |       at java.base/sun.net.www.protocol.http.HttpURLConnection.getInputStream0(HttpURLConnection.java:1924)
openmetadata_server         |       at java.base/sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1520)
openmetadata_server         |       at com.auth0.jwk.UrlJwkProvider.getJwks(UrlJwkProvider.java:135)
openmetadata_server         |       ... 69 common frames omitted
openmetadata_server         | ERROR [2023-03-21 11:06:44,292] [dw-48 - GET /api/v1/services/storageServices/name/sample_s3] o.o.s.e.CatalogGenericExceptionMapper - Got exception: [SigningKeyNotFoundException] / message [No key found in with kid Gb389a-9f76-gdjs-a92j-0242bk94356]
openmetadata_server         | com.auth0.jwk.SigningKeyNotFoundException: No key found in with kid Gb389a-9f76-gdjs-a92j-0242bk94356
openmetadata_server         |   at org.openmetadata.service.security.MultiUrlJwkProvider.get(MultiUrlJwkProvider.java:34)
openmetadata_server         |   at org.openmetadata.service.security.JwtFilter.validateAndReturnDecodedJwtToken(JwtFilter.java:163)
openmetadata_server         |   at org.openmetadata.service.security.JwtFilter.filter(JwtFilter.java:124)
openmetadata_server         |   at org.glassfish.jersey.server.ContainerFilteringStage.apply(ContainerFilteringStage.java:108)
openmetadata_server         |   at org.glassfish.jersey.server.ContainerFilteringStage.apply(ContainerFilteringStage.java:44)
openmetadata_server         |   at org.glassfish.jersey.process.internal.Stages.process(Stages.java:173)
openmetadata_server         |   at org.glassfish.jersey.server.ServerRuntime$1.run(ServerRuntime.java:248)
openmetadata_server         |   at org.glassfish.jersey.internal.Errors$1.call(Errors.java:248)
openmetadata_server         |   at org.glassfish.jersey.internal.Errors$1.call(Errors.java:244)
openmetadata_server         |   at org.glassfish.jersey.internal.Errors.process(Errors.java:292)
openmetadata_server         |   at org.glassfish.jersey.internal.Errors.process(Errors.java:274)
openmetadata_server         |   at org.glassfish.jersey.internal.Errors.process(Errors.java:244)
openmetadata_server         |   at org.glassfish.jersey.process.internal.RequestScope.runInScope(RequestScope.java:265)
openmetadata_server         |   at org.glassfish.jersey.server.ServerRuntime.process(ServerRuntime.java:235)
openmetadata_server         |   at org.glassfish.jersey.server.ApplicationHandler.handle(ApplicationHandler.java:684)
openmetadata_server         |   at org.glassfish.jersey.servlet.WebComponent.serviceImpl(WebComponent.java:394)
openmetadata_server         |   at org.glassfish.jersey.servlet.WebComponent.service(WebComponent.java:346)
openmetadata_server         |   at org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:358)
openmetadata_server         |   at org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:311)
openmetadata_server         |   at org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:205)
openmetadata_server         |   at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:799)
openmetadata_server         |   at org.eclipse.jetty.servlet.ServletHandler$ChainEnd.doFilter(ServletHandler.java:1656)
openmetadata_server         |   at io.dropwizard.servlets.ThreadNameFilter.doFilter(ThreadNameFilter.java:35)
openmetadata_server         |   at org.eclipse.jetty.servlet.FilterHolder.doFilter(FilterHolder.java:193)
openmetadata_server         |   at org.eclipse.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1626)
openmetadata_server         |   at io.dropwizard.jersey.filter.AllowedMethodsFilter.handle(AllowedMethodsFilter.java:47)
openmetadata_server         |   at io.dropwizard.jersey.filter.AllowedMethodsFilter.doFilter(AllowedMethodsFilter.java:41)
openmetadata_server         |   at org.eclipse.jetty.servlet.FilterHolder.doFilter(FilterHolder.java:193)
openmetadata_server         |   at org.eclipse.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1626)
openmetadata_server         |   at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:292)
openmetadata_server         |   at org.eclipse.jetty.servlet.FilterHolder.doFilter(FilterHolder.java:193)
openmetadata_server         |   at org.eclipse.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1626)
openmetadata_server         |   at io.github.maksymdolgykh.dropwizard.micrometer.MicrometerHttpFilter.doFilter(MicrometerHttpFilter.java:28)
openmetadata_server         |   at org.eclipse.jetty.servlet.FilterHolder.doFilter(FilterHolder.java:193)
openmetadata_server         |   at org.eclipse.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1626)
openmetadata_server         |   at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:552)
openmetadata_server         |   at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233)
openmetadata_server         |   at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1440)
openmetadata_server         |   at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188)
openmetadata_server         |   at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:505)
openmetadata_server         |   at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186)
openmetadata_server         |   at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1355)
openmetadata_server         |   at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
openmetadata_server         |   at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)
openmetadata_server         |   at com.codahale.metrics.jetty9.InstrumentedHandler.handle(InstrumentedHandler.java:284)
openmetadata_server         |   at io.dropwizard.jetty.RoutingHandler.handle(RoutingHandler.java:52)
openmetadata_server         |   at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:772)
openmetadata_server         |   at io.dropwizard.jetty.ZipExceptionHandlingGzipHandler.handle(ZipExceptionHandlingGzipHandler.java:26)
openmetadata_server         |   at org.eclipse.jetty.server.handler.RequestLogHandler.handle(RequestLogHandler.java:54)
openmetadata_server         |   at org.eclipse.jetty.server.handler.StatisticsHandler.handle(StatisticsHandler.java:181)
openmetadata_server         |   at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)
openmetadata_server         |   at org.eclipse.jetty.server.Server.handle(Server.java:516)
openmetadata_server         |   at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:487)
openmetadata_server         |   at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:732)
openmetadata_server         |   at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:479)
openmetadata_server         |   at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:277)
openmetadata_server         |   at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311)
openmetadata_server         |   at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105)
openmetadata_server         |   at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104)
openmetadata_server         |   at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:338)
openmetadata_server         |   at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:315)
openmetadata_server         |   at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:173)
openmetadata_server         |   at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:131)
openmetadata_server         |   at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:409)
openmetadata_server         |   at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:883)
openmetadata_server         |   at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1034)
openmetadata_server         |   at java.base/java.lang.Thread.run(Thread.java:829)
openmetadata_server         |   Suppressed: com.auth0.jwk.NetworkException: Cannot obtain jwks from url http://localhost:8585/api/v1/system/config/jwks
openmetadata_server         |       at com.auth0.jwk.UrlJwkProvider.getJwks(UrlJwkProvider.java:139)
openmetadata_server         |       at com.auth0.jwk.UrlJwkProvider.getAll(UrlJwkProvider.java:145)
openmetadata_server         |       at com.auth0.jwk.UrlJwkProvider.get(UrlJwkProvider.java:163)
openmetadata_server         |       at org.openmetadata.service.security.MultiUrlJwkProvider.get(MultiUrlJwkProvider.java:37)
openmetadata_server         |       ... 66 common frames omitted
openmetadata_server         |   Caused by: java.io.IOException: Server returned HTTP response code: 500 for URL: http://localhost:8585/api/v1/system/config/jwks
openmetadata_server         |       at java.base/sun.net.www.protocol.http.HttpURLConnection.getInputStream0(HttpURLConnection.java:1924)
openmetadata_server         |       at java.base/sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1520)
openmetadata_server         |       at com.auth0.jwk.UrlJwkProvider.getJwks(UrlJwkProvider.java:135)
openmetadata_server         |       ... 69 common frames omitted
openmetadata_server         | 172.16.240.5 - - [21/Mar/2023:11:06:44 +0000] "GET /api/v1/services/storageServices/name/sample_s3 HTTP/1.1" 500 145 "-" "python-requests/2.28.0" 5
openmetadata_ingestion      | [2023-03-21 11:06:45,573] {scheduler_job.py:599} INFO - Executor reports execution of sample_data.ingest_using_recipe run_id=manual__2023-03-21T11:06:29.605847+00:00 exited with status success for try_number 2
openmetadata_ingestion      | [2023-03-21 11:06:45,576] {scheduler_job.py:642} INFO - TaskInstance Finished: dag_id=sample_data, task_id=ingest_using_recipe, run_id=manual__2023-03-21T11:06:29.605847+00:00, map_index=-1, run_start_date=2023-03-21 11:06:44.024516+00:00, run_end_date=2023-03-21 11:06:44.315821+00:00, run_duration=0.291305, state=up_for_retry, executor_state=success, try_number=2, max_tries=3, job_id=18, pool=default_pool, queue=default, priority_weight=1, operator=PythonOperator, queued_dttm=2023-03-21 11:06:42.421045+00:00, queued_by_job_id=12, pid=1200
openmetadata_server         | 127.0.0.1 - - [21/Mar/2023:11:06:47 +0000] "GET /healthcheck HTTP/1.1" 200 263 "-" "curl/7.80.0" 7
openmetadata_ingestion      | [2023-03-21 11:06:54,590] {scheduler_job.py:353} INFO - 1 tasks up for execution:
openmetadata_ingestion      |   <TaskInstance: sample_data.ingest_using_recipe manual__2023-03-21T11:06:29.605847+00:00 [scheduled]>
openmetadata_ingestion      | [2023-03-21 11:06:54,590] {scheduler_job.py:418} INFO - DAG sample_data has 0/16 running and queued tasks
openmetadata_ingestion      | [2023-03-21 11:06:54,590] {scheduler_job.py:504} INFO - Setting the following tasks to queued state:
openmetadata_ingestion      |   <TaskInstance: sample_data.ingest_using_recipe manual__2023-03-21T11:06:29.605847+00:00 [scheduled]>
openmetadata_ingestion      | [2023-03-21 11:06:54,592] {scheduler_job.py:546} INFO - Sending TaskInstanceKey(dag_id='sample_data', task_id='ingest_using_recipe', run_id='manual__2023-03-21T11:06:29.605847+00:00', try_number=3, map_index=-1) to executor with priority 1 and queue default
openmetadata_ingestion      | [2023-03-21 11:06:54,592] {base_executor.py:91} INFO - Adding to queue: ['airflow', 'tasks', 'run', 'sample_data', 'ingest_using_recipe', 'manual__2023-03-21T11:06:29.605847+00:00', '--local', '--subdir', 'DAGS_FOLDER/airflow_sample_data.py']
openmetadata_ingestion      | [2023-03-21 11:06:54,595] {local_executor.py:79} INFO - QueuedLocalWorker running ['airflow', 'tasks', 'run', 'sample_data', 'ingest_using_recipe', 'manual__2023-03-21T11:06:29.605847+00:00', '--local', '--subdir', 'DAGS_FOLDER/airflow_sample_data.py']
openmetadata_ingestion      | [2023-03-21 11:06:54,629] {dagbag.py:508} INFO - Filling up the DagBag from /opt/airflow/dags/airflow_sample_data.py
openmetadata_ingestion      | [2023-03-21 11:06:56,044] {task_command.py:371} INFO - Running <TaskInstance: sample_data.ingest_using_recipe manual__2023-03-21T11:06:29.605847+00:00 [queued]> on host 2b39d8e79b0b
openmetadata_server         | 172.16.240.5 - - [21/Mar/2023:11:06:56 +0000] "GET /api/v1/version HTTP/1.1" 200 100 "-" "python-requests/2.28.0" 1
openmetadata_server         | 172.16.240.5 - - [21/Mar/2023:11:06:56 +0000] "GET /api/v1/version HTTP/1.1" 200 100 "-" "python-requests/2.28.0" 1
openmetadata_server         | 172.16.240.5 - - [21/Mar/2023:11:06:56 +0000] "GET /api/v1/version HTTP/1.1" 200 100 "-" "python-requests/2.28.0" 1
openmetadata_server         | INFO [2023-03-21 11:06:56,509] [dw-48 - GET /api/v1/system/config/jwks] o.o.s.e.CatalogGenericExceptionMapper - exception 
openmetadata_server         | javax.ws.rs.NotFoundException: HTTP 404 Not Found
openmetadata_server         |   at org.glassfish.jersey.server.ServerRuntime$1.run(ServerRuntime.java:253)
openmetadata_server         |   at org.glassfish.jersey.internal.Errors$1.call(Errors.java:248)
openmetadata_server         |   at org.glassfish.jersey.internal.Errors$1.call(Errors.java:244)
openmetadata_server         |   at org.glassfish.jersey.internal.Errors.process(Errors.java:292)
openmetadata_server         |   at org.glassfish.jersey.internal.Errors.process(Errors.java:274)
openmetadata_server         |   at org.glassfish.jersey.internal.Errors.process(Errors.java:244)
openmetadata_server         |   at org.glassfish.jersey.process.internal.RequestScope.runInScope(RequestScope.java:265)
openmetadata_server         |   at org.glassfish.jersey.server.ServerRuntime.process(ServerRuntime.java:235)
openmetadata_server         |   at org.glassfish.jersey.server.ApplicationHandler.handle(ApplicationHandler.java:684)
openmetadata_server         |   at org.glassfish.jersey.servlet.WebComponent.serviceImpl(WebComponent.java:394)
openmetadata_server         |   at org.glassfish.jersey.servlet.WebComponent.service(WebComponent.java:346)
openmetadata_server         |   at org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:358)
openmetadata_server         |   at org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:311)
openmetadata_server         |   at org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:205)
openmetadata_server         |   at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:799)
openmetadata_server         |   at org.eclipse.jetty.servlet.ServletHandler$ChainEnd.doFilter(ServletHandler.java:1656)
openmetadata_server         |   at io.dropwizard.servlets.ThreadNameFilter.doFilter(ThreadNameFilter.java:35)
openmetadata_server         |   at org.eclipse.jetty.servlet.FilterHolder.doFilter(FilterHolder.java:193)
openmetadata_server         |   at org.eclipse.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1626)
openmetadata_server         |   at io.dropwizard.jersey.filter.AllowedMethodsFilter.handle(AllowedMethodsFilter.java:47)
openmetadata_server         |   at io.dropwizard.jersey.filter.AllowedMethodsFilter.doFilter(AllowedMethodsFilter.java:41)
openmetadata_server         |   at org.eclipse.jetty.servlet.FilterHolder.doFilter(FilterHolder.java:193)
openmetadata_server         |   at org.eclipse.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1626)
openmetadata_server         |   at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:292)
openmetadata_server         |   at org.eclipse.jetty.servlet.FilterHolder.doFilter(FilterHolder.java:193)
openmetadata_server         |   at org.eclipse.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1626)
openmetadata_server         |   at io.github.maksymdolgykh.dropwizard.micrometer.MicrometerHttpFilter.doFilter(MicrometerHttpFilter.java:28)
openmetadata_server         |   at org.eclipse.jetty.servlet.FilterHolder.doFilter(FilterHolder.java:193)
openmetadata_server         |   at org.eclipse.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1626)
openmetadata_server         |   at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:552)
openmetadata_server         |   at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233)
openmetadata_server         |   at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1440)
openmetadata_server         |   at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188)
openmetadata_server         |   at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:505)
openmetadata_server         |   at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186)
openmetadata_server         |   at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1355)
openmetadata_server         |   at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
openmetadata_server         |   at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)
openmetadata_server         |   at com.codahale.metrics.jetty9.InstrumentedHandler.handle(InstrumentedHandler.java:284)
openmetadata_server         |   at io.dropwizard.jetty.RoutingHandler.handle(RoutingHandler.java:52)
openmetadata_server         |   at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:772)
openmetadata_server         |   at io.dropwizard.jetty.ZipExceptionHandlingGzipHandler.handle(ZipExceptionHandlingGzipHandler.java:26)
openmetadata_server         |   at org.eclipse.jetty.server.handler.RequestLogHandler.handle(RequestLogHandler.java:54)
openmetadata_server         |   at org.eclipse.jetty.server.handler.StatisticsHandler.handle(StatisticsHandler.java:181)
openmetadata_server         |   at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)
openmetadata_server         |   at org.eclipse.jetty.server.Server.handle(Server.java:516)
openmetadata_server         |   at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:487)
openmetadata_server         |   at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:732)
openmetadata_server         |   at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:479)
openmetadata_server         |   at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:277)
openmetadata_server         |   at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311)
openmetadata_server         |   at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105)
openmetadata_server         |   at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104)
openmetadata_server         |   at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:338)
openmetadata_server         |   at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:315)
openmetadata_server         |   at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:173)
openmetadata_server         |   at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:131)
openmetadata_server         |   at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:409)
openmetadata_server         |   at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:883)
openmetadata_server         |   at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1034)
openmetadata_server         |   at java.base/java.lang.Thread.run(Thread.java:829)
openmetadata_server         | ERROR [2023-03-21 11:06:56,509] [dw-48 - GET /api/v1/system/config/jwks] o.o.s.e.CatalogGenericExceptionMapper - Got exception: [NotFoundException] / message [HTTP 404 Not Found]
openmetadata_server         | javax.ws.rs.NotFoundException: HTTP 404 Not Found
openmetadata_server         |   at org.glassfish.jersey.server.ServerRuntime$1.run(ServerRuntime.java:253)
openmetadata_server         |   at org.glassfish.jersey.internal.Errors$1.call(Errors.java:248)
openmetadata_server         |   at org.glassfish.jersey.internal.Errors$1.call(Errors.java:244)
openmetadata_server         |   at org.glassfish.jersey.internal.Errors.process(Errors.java:292)
openmetadata_server         |   at org.glassfish.jersey.internal.Errors.process(Errors.java:274)
openmetadata_server         |   at org.glassfish.jersey.internal.Errors.process(Errors.java:244)
openmetadata_server         |   at org.glassfish.jersey.process.internal.RequestScope.runInScope(RequestScope.java:265)
openmetadata_server         |   at org.glassfish.jersey.server.ServerRuntime.process(ServerRuntime.java:235)
openmetadata_server         |   at org.glassfish.jersey.server.ApplicationHandler.handle(ApplicationHandler.java:684)
openmetadata_server         |   at org.glassfish.jersey.servlet.WebComponent.serviceImpl(WebComponent.java:394)
openmetadata_server         |   at org.glassfish.jersey.servlet.WebComponent.service(WebComponent.java:346)
openmetadata_server         |   at org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:358)
openmetadata_server         |   at org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:311)
openmetadata_server         |   at org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:205)
openmetadata_server         |   at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:799)
openmetadata_server         |   at org.eclipse.jetty.servlet.ServletHandler$ChainEnd.doFilter(ServletHandler.java:1656)
openmetadata_server         |   at io.dropwizard.servlets.ThreadNameFilter.doFilter(ThreadNameFilter.java:35)
openmetadata_server         |   at org.eclipse.jetty.servlet.FilterHolder.doFilter(FilterHolder.java:193)
openmetadata_server         |   at org.eclipse.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1626)
openmetadata_server         |   at io.dropwizard.jersey.filter.AllowedMethodsFilter.handle(AllowedMethodsFilter.java:47)
openmetadata_server         |   at io.dropwizard.jersey.filter.AllowedMethodsFilter.doFilter(AllowedMethodsFilter.java:41)
openmetadata_server         |   at org.eclipse.jetty.servlet.FilterHolder.doFilter(FilterHolder.java:193)
openmetadata_server         |   at org.eclipse.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1626)
openmetadata_server         |   at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:292)
openmetadata_server         |   at org.eclipse.jetty.servlet.FilterHolder.doFilter(FilterHolder.java:193)
openmetadata_server         |   at org.eclipse.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1626)
openmetadata_server         |   at io.github.maksymdolgykh.dropwizard.micrometer.MicrometerHttpFilter.doFilter(MicrometerHttpFilter.java:28)
openmetadata_server         |   at org.eclipse.jetty.servlet.FilterHolder.doFilter(FilterHolder.java:193)
openmetadata_server         |   at org.eclipse.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1626)
openmetadata_server         |   at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:552)
openmetadata_server         |   at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233)
openmetadata_server         |   at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1440)
openmetadata_server         |   at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188)
openmetadata_server         |   at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:505)
openmetadata_server         |   at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186)
openmetadata_server         |   at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1355)
openmetadata_server         |   at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
openmetadata_server         |   at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)
openmetadata_server         |   at com.codahale.metrics.jetty9.InstrumentedHandler.handle(InstrumentedHandler.java:284)
openmetadata_server         |   at io.dropwizard.jetty.RoutingHandler.handle(RoutingHandler.java:52)
openmetadata_server         |   at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:772)
openmetadata_server         |   at io.dropwizard.jetty.ZipExceptionHandlingGzipHandler.handle(ZipExceptionHandlingGzipHandler.java:26)
openmetadata_server         |   at org.eclipse.jetty.server.handler.RequestLogHandler.handle(RequestLogHandler.java:54)
openmetadata_server         |   at org.eclipse.jetty.server.handler.StatisticsHandler.handle(StatisticsHandler.java:181)
openmetadata_server         |   at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)
openmetadata_server         |   at org.eclipse.jetty.server.Server.handle(Server.java:516)
openmetadata_server         |   at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:487)
openmetadata_server         |   at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:732)
openmetadata_server         |   at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:479)
openmetadata_server         |   at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:277)
openmetadata_server         |   at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311)
openmetadata_server         |   at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105)
openmetadata_server         |   at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104)
openmetadata_server         |   at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:338)
openmetadata_server         |   at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:315)
openmetadata_server         |   at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:173)
openmetadata_server         |   at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:131)
openmetadata_server         |   at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:409)
openmetadata_server         |   at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:883)
openmetadata_server         |   at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1034)
openmetadata_server         |   at java.base/java.lang.Thread.run(Thread.java:829)
openmetadata_server         | 127.0.0.1 - - [21/Mar/2023:11:06:56 +0000] "GET /api/v1/system/config/jwks HTTP/1.1" 500 105 "-" "Java/11.0.18" 2
openmetadata_server         | INFO [2023-03-21 11:06:56,510] [dw-52 - GET /api/v1/services/storageServices/name/sample_s3] o.o.s.e.CatalogGenericExceptionMapper - exception 
openmetadata_server         | com.auth0.jwk.SigningKeyNotFoundException: No key found in with kid Gb389a-9f76-gdjs-a92j-0242bk94356
openmetadata_server         |   at org.openmetadata.service.security.MultiUrlJwkProvider.get(MultiUrlJwkProvider.java:34)
openmetadata_server         |   at org.openmetadata.service.security.JwtFilter.validateAndReturnDecodedJwtToken(JwtFilter.java:163)
openmetadata_server         |   at org.openmetadata.service.security.JwtFilter.filter(JwtFilter.java:124)
openmetadata_server         |   at org.glassfish.jersey.server.ContainerFilteringStage.apply(ContainerFilteringStage.java:108)
openmetadata_server         |   at org.glassfish.jersey.server.ContainerFilteringStage.apply(ContainerFilteringStage.java:44)
openmetadata_server         |   at org.glassfish.jersey.process.internal.Stages.process(Stages.java:173)
openmetadata_server         |   at org.glassfish.jersey.server.ServerRuntime$1.run(ServerRuntime.java:248)
openmetadata_server         |   at org.glassfish.jersey.internal.Errors$1.call(Errors.java:248)
openmetadata_server         |   at org.glassfish.jersey.internal.Errors$1.call(Errors.java:244)
openmetadata_server         |   at org.glassfish.jersey.internal.Errors.process(Errors.java:292)
openmetadata_server         |   at org.glassfish.jersey.internal.Errors.process(Errors.java:274)
openmetadata_server         |   at org.glassfish.jersey.internal.Errors.process(Errors.java:244)
openmetadata_server         |   at org.glassfish.jersey.process.internal.RequestScope.runInScope(RequestScope.java:265)
openmetadata_server         |   at org.glassfish.jersey.server.ServerRuntime.process(ServerRuntime.java:235)
openmetadata_server         |   at org.glassfish.jersey.server.ApplicationHandler.handle(ApplicationHandler.java:684)
openmetadata_server         |   at org.glassfish.jersey.servlet.WebComponent.serviceImpl(WebComponent.java:394)
openmetadata_server         |   at org.glassfish.jersey.servlet.WebComponent.service(WebComponent.java:346)
openmetadata_server         |   at org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:358)
openmetadata_server         |   at org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:311)
openmetadata_server         |   at org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:205)
openmetadata_server         |   at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:799)
openmetadata_server         |   at org.eclipse.jetty.servlet.ServletHandler$ChainEnd.doFilter(ServletHandler.java:1656)
openmetadata_server         |   at io.dropwizard.servlets.ThreadNameFilter.doFilter(ThreadNameFilter.java:35)
openmetadata_server         |   at org.eclipse.jetty.servlet.FilterHolder.doFilter(FilterHolder.java:193)
openmetadata_server         |   at org.eclipse.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1626)
openmetadata_server         |   at io.dropwizard.jersey.filter.AllowedMethodsFilter.handle(AllowedMethodsFilter.java:47)
openmetadata_server         |   at io.dropwizard.jersey.filter.AllowedMethodsFilter.doFilter(AllowedMethodsFilter.java:41)
openmetadata_server         |   at org.eclipse.jetty.servlet.FilterHolder.doFilter(FilterHolder.java:193)
openmetadata_server         |   at org.eclipse.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1626)
openmetadata_server         |   at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:292)
openmetadata_server         |   at org.eclipse.jetty.servlet.FilterHolder.doFilter(FilterHolder.java:193)
openmetadata_server         |   at org.eclipse.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1626)
openmetadata_server         |   at io.github.maksymdolgykh.dropwizard.micrometer.MicrometerHttpFilter.doFilter(MicrometerHttpFilter.java:28)
openmetadata_server         |   at org.eclipse.jetty.servlet.FilterHolder.doFilter(FilterHolder.java:193)
openmetadata_server         |   at org.eclipse.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1626)
openmetadata_server         |   at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:552)
openmetadata_server         |   at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233)
openmetadata_server         |   at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1440)
openmetadata_server         |   at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188)
openmetadata_server         |   at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:505)
openmetadata_server         |   at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186)
openmetadata_server         |   at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1355)
openmetadata_server         |   at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
openmetadata_server         |   at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)
openmetadata_server         |   at com.codahale.metrics.jetty9.InstrumentedHandler.handle(InstrumentedHandler.java:284)
openmetadata_server         |   at io.dropwizard.jetty.RoutingHandler.handle(RoutingHandler.java:52)
openmetadata_server         |   at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:772)
openmetadata_server         |   at io.dropwizard.jetty.ZipExceptionHandlingGzipHandler.handle(ZipExceptionHandlingGzipHandler.java:26)
openmetadata_server         |   at org.eclipse.jetty.server.handler.RequestLogHandler.handle(RequestLogHandler.java:54)
openmetadata_server         |   at org.eclipse.jetty.server.handler.StatisticsHandler.handle(StatisticsHandler.java:181)
openmetadata_server         |   at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)
openmetadata_server         |   at org.eclipse.jetty.server.Server.handle(Server.java:516)
openmetadata_server         |   at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:487)
openmetadata_server         |   at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:732)
openmetadata_server         |   at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:479)
openmetadata_server         |   at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:277)
openmetadata_server         |   at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311)
openmetadata_server         |   at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105)
openmetadata_server         |   at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104)
openmetadata_server         |   at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:338)
openmetadata_server         |   at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:315)
openmetadata_server         |   at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:173)
openmetadata_server         |   at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:131)
openmetadata_server         |   at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:409)
openmetadata_server         |   at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:883)
openmetadata_server         |   at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1034)
openmetadata_server         |   at java.base/java.lang.Thread.run(Thread.java:829)
openmetadata_server         |   Suppressed: com.auth0.jwk.NetworkException: Cannot obtain jwks from url http://localhost:8585/api/v1/system/config/jwks
openmetadata_server         |       at com.auth0.jwk.UrlJwkProvider.getJwks(UrlJwkProvider.java:139)
openmetadata_server         |       at com.auth0.jwk.UrlJwkProvider.getAll(UrlJwkProvider.java:145)
openmetadata_server         |       at com.auth0.jwk.UrlJwkProvider.get(UrlJwkProvider.java:163)
openmetadata_server         |       at org.openmetadata.service.security.MultiUrlJwkProvider.get(MultiUrlJwkProvider.java:37)
openmetadata_server         |       ... 66 common frames omitted
openmetadata_server         |   Caused by: java.io.IOException: Server returned HTTP response code: 500 for URL: http://localhost:8585/api/v1/system/config/jwks
openmetadata_server         |       at java.base/sun.net.www.protocol.http.HttpURLConnection.getInputStream0(HttpURLConnection.java:1924)
openmetadata_server         |       at java.base/sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1520)
openmetadata_server         |       at com.auth0.jwk.UrlJwkProvider.getJwks(UrlJwkProvider.java:135)
openmetadata_server         |       ... 69 common frames omitted
openmetadata_server         | ERROR [2023-03-21 11:06:56,510] [dw-52 - GET /api/v1/services/storageServices/name/sample_s3] o.o.s.e.CatalogGenericExceptionMapper - Got exception: [SigningKeyNotFoundException] / message [No key found in with kid Gb389a-9f76-gdjs-a92j-0242bk94356]
openmetadata_server         | com.auth0.jwk.SigningKeyNotFoundException: No key found in with kid Gb389a-9f76-gdjs-a92j-0242bk94356
openmetadata_server         |   at org.openmetadata.service.security.MultiUrlJwkProvider.get(MultiUrlJwkProvider.java:34)
openmetadata_server         |   at org.openmetadata.service.security.JwtFilter.validateAndReturnDecodedJwtToken(JwtFilter.java:163)
openmetadata_server         |   at org.openmetadata.service.security.JwtFilter.filter(JwtFilter.java:124)
openmetadata_server         |   at org.glassfish.jersey.server.ContainerFilteringStage.apply(ContainerFilteringStage.java:108)
openmetadata_server         |   at org.glassfish.jersey.server.ContainerFilteringStage.apply(ContainerFilteringStage.java:44)
openmetadata_server         |   at org.glassfish.jersey.process.internal.Stages.process(Stages.java:173)
openmetadata_server         |   at org.glassfish.jersey.server.ServerRuntime$1.run(ServerRuntime.java:248)
openmetadata_server         |   at org.glassfish.jersey.internal.Errors$1.call(Errors.java:248)
openmetadata_server         |   at org.glassfish.jersey.internal.Errors$1.call(Errors.java:244)
openmetadata_server         |   at org.glassfish.jersey.internal.Errors.process(Errors.java:292)
openmetadata_server         |   at org.glassfish.jersey.internal.Errors.process(Errors.java:274)
openmetadata_server         |   at org.glassfish.jersey.internal.Errors.process(Errors.java:244)
openmetadata_server         |   at org.glassfish.jersey.process.internal.RequestScope.runInScope(RequestScope.java:265)
openmetadata_server         |   at org.glassfish.jersey.server.ServerRuntime.process(ServerRuntime.java:235)
openmetadata_server         |   at org.glassfish.jersey.server.ApplicationHandler.handle(ApplicationHandler.java:684)
openmetadata_server         |   at org.glassfish.jersey.servlet.WebComponent.serviceImpl(WebComponent.java:394)
openmetadata_server         |   at org.glassfish.jersey.servlet.WebComponent.service(WebComponent.java:346)
openmetadata_server         |   at org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:358)
openmetadata_server         |   at org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:311)
openmetadata_server         |   at org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:205)
openmetadata_server         |   at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:799)
openmetadata_server         |   at org.eclipse.jetty.servlet.ServletHandler$ChainEnd.doFilter(ServletHandler.java:1656)
openmetadata_server         |   at io.dropwizard.servlets.ThreadNameFilter.doFilter(ThreadNameFilter.java:35)
openmetadata_server         |   at org.eclipse.jetty.servlet.FilterHolder.doFilter(FilterHolder.java:193)
openmetadata_server         |   at org.eclipse.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1626)
openmetadata_server         |   at io.dropwizard.jersey.filter.AllowedMethodsFilter.handle(AllowedMethodsFilter.java:47)
openmetadata_server         |   at io.dropwizard.jersey.filter.AllowedMethodsFilter.doFilter(AllowedMethodsFilter.java:41)
openmetadata_server         |   at org.eclipse.jetty.servlet.FilterHolder.doFilter(FilterHolder.java:193)
openmetadata_server         |   at org.eclipse.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1626)
openmetadata_server         |   at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:292)
openmetadata_server         |   at org.eclipse.jetty.servlet.FilterHolder.doFilter(FilterHolder.java:193)
openmetadata_server         |   at org.eclipse.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1626)
openmetadata_server         |   at io.github.maksymdolgykh.dropwizard.micrometer.MicrometerHttpFilter.doFilter(MicrometerHttpFilter.java:28)
openmetadata_server         |   at org.eclipse.jetty.servlet.FilterHolder.doFilter(FilterHolder.java:193)
openmetadata_server         |   at org.eclipse.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1626)
openmetadata_server         |   at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:552)
openmetadata_server         |   at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233)
openmetadata_server         |   at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1440)
openmetadata_server         |   at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188)
openmetadata_server         |   at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:505)
openmetadata_server         |   at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186)
openmetadata_server         |   at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1355)
openmetadata_server         |   at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
openmetadata_server         |   at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)
openmetadata_server         |   at com.codahale.metrics.jetty9.InstrumentedHandler.handle(InstrumentedHandler.java:284)
openmetadata_server         |   at io.dropwizard.jetty.RoutingHandler.handle(RoutingHandler.java:52)
openmetadata_server         |   at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:772)
openmetadata_server         |   at io.dropwizard.jetty.ZipExceptionHandlingGzipHandler.handle(ZipExceptionHandlingGzipHandler.java:26)
openmetadata_server         |   at org.eclipse.jetty.server.handler.RequestLogHandler.handle(RequestLogHandler.java:54)
openmetadata_server         |   at org.eclipse.jetty.server.handler.StatisticsHandler.handle(StatisticsHandler.java:181)
openmetadata_server         |   at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)
openmetadata_server         |   at org.eclipse.jetty.server.Server.handle(Server.java:516)
openmetadata_server         |   at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:487)
openmetadata_server         |   at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:732)
openmetadata_server         |   at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:479)
openmetadata_server         |   at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:277)
openmetadata_server         |   at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311)
openmetadata_server         |   at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105)
openmetadata_server         |   at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104)
openmetadata_server         |   at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:338)
openmetadata_server         |   at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:315)
openmetadata_server         |   at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:173)
openmetadata_server         |   at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:131)
openmetadata_server         |   at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:409)
openmetadata_server         |   at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:883)
openmetadata_server         |   at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1034)
openmetadata_server         |   at java.base/java.lang.Thread.run(Thread.java:829)
openmetadata_server         |   Suppressed: com.auth0.jwk.NetworkException: Cannot obtain jwks from url http://localhost:8585/api/v1/system/config/jwks
openmetadata_server         |       at com.auth0.jwk.UrlJwkProvider.getJwks(UrlJwkProvider.java:139)
openmetadata_server         |       at com.auth0.jwk.UrlJwkProvider.getAll(UrlJwkProvider.java:145)
openmetadata_server         |       at com.auth0.jwk.UrlJwkProvider.get(UrlJwkProvider.java:163)
openmetadata_server         |       at org.openmetadata.service.security.MultiUrlJwkProvider.get(MultiUrlJwkProvider.java:37)
openmetadata_server         |       ... 66 common frames omitted
openmetadata_server         |   Caused by: java.io.IOException: Server returned HTTP response code: 500 for URL: http://localhost:8585/api/v1/system/config/jwks
openmetadata_server         |       at java.base/sun.net.www.protocol.http.HttpURLConnection.getInputStream0(HttpURLConnection.java:1924)
openmetadata_server         |       at java.base/sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1520)
openmetadata_server         |       at com.auth0.jwk.UrlJwkProvider.getJwks(UrlJwkProvider.java:135)
openmetadata_server         |       ... 69 common frames omitted
openmetadata_server         | 172.16.240.5 - - [21/Mar/2023:11:06:56 +0000] "GET /api/v1/services/storageServices/name/sample_s3 HTTP/1.1" 500 145 "-" "python-requests/2.28.0" 4
openmetadata_ingestion      | [2023-03-21 11:06:57,015] {scheduler_job.py:599} INFO - Executor reports execution of sample_data.ingest_using_recipe run_id=manual__2023-03-21T11:06:29.605847+00:00 exited with status success for try_number 3
openmetadata_ingestion      | [2023-03-21 11:06:57,019] {scheduler_job.py:642} INFO - TaskInstance Finished: dag_id=sample_data, task_id=ingest_using_recipe, run_id=manual__2023-03-21T11:06:29.605847+00:00, map_index=-1, run_start_date=2023-03-21 11:06:56.240414+00:00, run_end_date=2023-03-21 11:06:56.536132+00:00, run_duration=0.295718, state=up_for_retry, executor_state=success, try_number=3, max_tries=3, job_id=19, pool=default_pool, queue=default, priority_weight=1, operator=PythonOperator, queued_dttm=2023-03-21 11:06:54.591144+00:00, queued_by_job_id=12, pid=1222
openmetadata_server         | 127.0.0.1 - - [21/Mar/2023:11:07:17 +0000] "GET /healthcheck HTTP/1.1" 200 263 "-" "curl/7.80.0" 11
openmetadata_ingestion      | [2023-03-21 11:07:37,526] {scheduler_job.py:1233} INFO - Resetting orphaned tasks for active dag runs
openmetadata_server         | 127.0.0.1 - - [21/Mar/2023:11:07:47 +0000] "GET /healthcheck HTTP/1.1" 200 263 "-" "curl/7.80.0" 6
openmetadata_server         | 127.0.0.1 - - [21/Mar/2023:11:08:17 +0000] "GET /healthcheck HTTP/1.1" 200 263 "-" "curl/7.80.0" 2
TeddyCr commented 1 year ago

@Unanimad @bdnf you need to make sure the line below point to https in openmetadata.yaml

publicKeyUrls: ${AUTHENTICATION_PUBLIC_KEYS:-[https://localhost:8585/api/v1/system/config/jwks]}
pmbrull commented 1 year ago

closing this out, since this looks like a configuration issue. Thanks. Feel free to reach out in Slack if the issue persists