search

gislab-augsburg / helm-charts

it@M Helm Charts
https://artifacthub.io/packages/search?repo=it-at-m
MIT License
0 stars 0 forks source link

dave-backend: elasticsearch 503 Service Unavailable #17

Closed gislab-augsburg closed 7 months ago

gislab-augsburg commented 8 months ago

Error in dave-backend pod:

Caused by: org.elasticsearch.ElasticsearchStatusException: Elasticsearch exception [type=search_phase_execution_exception, reason=all shards failed]
...
Suppressed: org.elasticsearch.client.ResponseException: method [POST], host [http://dave-elasticsearch:9200], URI [/zaehlstelle/_search?typed_keys=true&max_concurrent_shard_requests=5&search_type=query_then_fetch&batched_reduce_size=512], status line [HTTP/1.1 503 Service Unavailable]
{"error":{"root_cause":[{"type":"no_shard_available_action_exception","reason":null}],"type":"search_phase_execution_exception","reason":"all shards failed","phase":"query","grouped":true,"failed_shards":[{"shard":0,"index":"zaehlstelle","node":null,"reason":{"type":"no_shard_available_action_exception","reason":null}}]},"status":503}
``` mb@nbo00370518:~/dave2/helm-charts/charts/dave$ oc logs dave-backend-service-84554bcff9-7kp5t -f Starting the Java application using /opt/jboss/container/java/run/run-java.sh ... INFO exec -a "java" java -Djavax.net.ssl.trustStore=/mnt/cacerts-lhm -Djavax.net.ssl.trustStorePassword=changeit -Xmx1g --add-modules java.se --add-exports java.base/jdk.internal.ref=ALL-UNNAMED --add-opens java.base/java.lang=ALL-UNNAMED --add-opens java.base/java.nio=ALL-UNNAMED --add-opens java.base/sun.nio.ch=ALL-UNNAMED --add-opens java.management/sun.management=ALL-UNNAMED --add-opens jdk.management/com.sun.management.internal=ALL-UNNAMED" -Dhz.integritychecker.enabled=false -cp "." -jar /deployments/spring-boot-application.jar INFO running in /deployments Picked up JAVA_TOOL_OPTIONS: -Dfile.encoding=UTF-8 -Dhz.integritychecker.enabled=false WARNING: Unknown module: ALL-UNNAMED" specified to --add-opens --------------------------------------------------------------------------------------------------------------------------------------------------- _____ __ __ | __ \ /\ \ \ / / | | | | / \ \ \ / / ___ | | | | / /\ \ \ \/ / / _ \ | |__| | _ / ____ \ _ \ / | __/ _ |_____/ (_) /_/ \_\ (_) \/ \___| (_) _________________________ /\\ _____ | | | | | | \ ,-----, / \\____/__|__\_ |___|_____|_____|____|_|___\ ,--'---:---`--, / | _ | `| | | | \ ==(o)-----(o)==J `(o)-------(o)= --(o)(o)--------------(o)--' Datenbank und Auswertungen von Verkehrszählungen Application Name : dave-backend Spring Boot Version : (v2.7.8) --------------------------------------------------------------------------------------------------------------------------------------------------- 2024.03.20 16:09:27.523 | dave-backend | TraceId: | SpanId: ] | INFO | [background-preinit] | Version | [Version.java : 21] - HV000001: Hibernate Validator 6.2.5.Final 2024.03.20 16:09:27.645 | dave-backend | TraceId: | SpanId: ] | INFO | [main] | DaveBackendApplication | [StartupInfoLogger.java : 55] - Starting DaveBackendApplication using Java 11.0.22 on dave-backend-service-84554bcff9-7kp5t with PID 1 (/deployments/spring-boot-application.jar started by 1003100000 in /deployments) 2024.03.20 16:09:27.690 | dave-backend | TraceId: | SpanId: ] | DEBUG | [main] | DaveBackendApplication | [StartupInfoLogger.java : 56] - Running with Spring Boot v2.7.8, Spring v5.3.25 2024.03.20 16:09:27.692 | dave-backend | TraceId: | SpanId: ] | INFO | [main] | DaveBackendApplication | [SpringApplication.java : 637] - The following 1 profile is active: "dev" 2024.03.20 16:09:32.011 | dave-backend | TraceId: | SpanId: ] | INFO | [main] | RepositoryConfigurationDelegate | [RepositoryConfigurationDelegate.java : 262] - Multiple Spring Data modules found, entering strict repository configuration mode 2024.03.20 16:09:32.012 | dave-backend | TraceId: | SpanId: ] | INFO | [main] | RepositoryConfigurationDelegate | [RepositoryConfigurationDelegate.java : 132] - Bootstrapping Spring Data Elasticsearch repositories in DEFAULT mode. 2024.03.20 16:09:32.118 | dave-backend | TraceId: | SpanId: ] | INFO | [main] | RepositoryConfigurationDelegate | [RepositoryConfigurationDelegate.java : 201] - Finished Spring Data repository scanning in 95 ms. Found 2 Elasticsearch repository interfaces. 2024.03.20 16:09:32.133 | dave-backend | TraceId: | SpanId: ] | INFO | [main] | RepositoryConfigurationDelegate | [RepositoryConfigurationDelegate.java : 262] - Multiple Spring Data modules found, entering strict repository configuration mode 2024.03.20 16:09:32.133 | dave-backend | TraceId: | SpanId: ] | INFO | [main] | RepositoryConfigurationDelegate | [RepositoryConfigurationDelegate.java : 132] - Bootstrapping Spring Data JPA repositories in DEFAULT mode. 2024.03.20 16:09:32.296 | dave-backend | TraceId: | SpanId: ] | INFO | [main] | RepositoryConfigurationExtensionSupport | [RepositoryConfigurationExtensionSupport.java : 349] - Spring Data JPA - Could not safely identify store assignment for repository candidate interface de.muenchen.dave.repositories.elasticsearch.CustomSuggestIndex; If you want this repository to be a JPA repository, consider annotating your entities with one of these annotations: javax.persistence.Entity, javax.persistence.MappedSuperclass (preferred), or consider extending one of the following types with your repository: org.springframework.data.jpa.repository.JpaRepository 2024.03.20 16:09:32.303 | dave-backend | TraceId: | SpanId: ] | INFO | [main] | RepositoryConfigurationExtensionSupport | [RepositoryConfigurationExtensionSupport.java : 349] - Spring Data JPA - Could not safely identify store assignment for repository candidate interface de.muenchen.dave.repositories.elasticsearch.ZaehlstelleIndex; If you want this repository to be a JPA repository, consider annotating your entities with one of these annotations: javax.persistence.Entity, javax.persistence.MappedSuperclass (preferred), or consider extending one of the following types with your repository: org.springframework.data.jpa.repository.JpaRepository 2024.03.20 16:09:32.335 | dave-backend | TraceId: | SpanId: ] | INFO | [main] | RepositoryConfigurationDelegate | [RepositoryConfigurationDelegate.java : 201] - Finished Spring Data repository scanning in 196 ms. Found 7 JPA repository interfaces. 2024.03.20 16:09:33.541 | dave-backend | TraceId: | SpanId: ] | INFO | [main] | RepositoryConfigurationDelegate | [RepositoryConfigurationDelegate.java : 262] - Multiple Spring Data modules found, entering strict repository configuration mode 2024.03.20 16:09:33.542 | dave-backend | TraceId: | SpanId: ] | INFO | [main] | RepositoryConfigurationDelegate | [RepositoryConfigurationDelegate.java : 132] - Bootstrapping Spring Data Reactive Elasticsearch repositories in DEFAULT mode. 2024.03.20 16:09:33.593 | dave-backend | TraceId: | SpanId: ] | INFO | [main] | RepositoryConfigurationExtensionSupport | [RepositoryConfigurationExtensionSupport.java : 349] - Spring Data Reactive Elasticsearch - Could not safely identify store assignment for repository candidate interface de.muenchen.dave.repositories.relationaldb.InfoMessageRepository; If you want this repository to be a Reactive Elasticsearch repository, consider annotating your entities with one of these annotations: org.springframework.data.elasticsearch.annotations.Document (preferred), or consider extending one of the following types with your repository: org.springframework.data.elasticsearch.repository.ReactiveElasticsearchRepository 2024.03.20 16:09:33.597 | dave-backend | TraceId: | SpanId: ] | INFO | [main] | RepositoryConfigurationExtensionSupport | [RepositoryConfigurationExtensionSupport.java : 349] - Spring Data Reactive Elasticsearch - Could not safely identify store assignment for repository candidate interface de.muenchen.dave.repositories.relationaldb.HochrechnungsfaktorRepository; If you want this repository to be a Reactive Elasticsearch repository, consider annotating your entities with one of these annotations: org.springframework.data.elasticsearch.annotations.Document (preferred), or consider extending one of the following types with your repository: org.springframework.data.elasticsearch.repository.ReactiveElasticsearchRepository 2024.03.20 16:09:33.598 | dave-backend | TraceId: | SpanId: ] | INFO | [main] | RepositoryConfigurationExtensionSupport | [RepositoryConfigurationExtensionSupport.java : 349] - Spring Data Reactive Elasticsearch - Could not safely identify store assignment for repository candidate interface de.muenchen.dave.repositories.relationaldb.ChatMessageRepository; If you want this repository to be a Reactive Elasticsearch repository, consider annotating your entities with one of these annotations: org.springframework.data.elasticsearch.annotations.Document (preferred), or consider extending one of the following types with your repository: org.springframework.data.elasticsearch.repository.ReactiveElasticsearchRepository 2024.03.20 16:09:33.599 | dave-backend | TraceId: | SpanId: ] | INFO | [main] | RepositoryConfigurationExtensionSupport | [RepositoryConfigurationExtensionSupport.java : 349] - Spring Data Reactive Elasticsearch - Could not safely identify store assignment for repository candidate interface de.muenchen.dave.repositories.relationaldb.PkwEinheitRepository; If you want this repository to be a Reactive Elasticsearch repository, consider annotating your entities with one of these annotations: org.springframework.data.elasticsearch.annotations.Document (preferred), or consider extending one of the following types with your repository: org.springframework.data.elasticsearch.repository.ReactiveElasticsearchRepository 2024.03.20 16:09:33.600 | dave-backend | TraceId: | SpanId: ] | INFO | [main] | RepositoryConfigurationExtensionSupport | [RepositoryConfigurationExtensionSupport.java : 349] - Spring Data Reactive Elasticsearch - Could not safely identify store assignment for repository candidate interface de.muenchen.dave.repositories.relationaldb.ZeitintervallRepository; If you want this repository to be a Reactive Elasticsearch repository, consider annotating your entities with one of these annotations: org.springframework.data.elasticsearch.annotations.Document (preferred), or consider extending one of the following types with your repository: org.springframework.data.elasticsearch.repository.ReactiveElasticsearchRepository 2024.03.20 16:09:33.601 | dave-backend | TraceId: | SpanId: ] | INFO | [main] | RepositoryConfigurationExtensionSupport | [RepositoryConfigurationExtensionSupport.java : 349] - Spring Data Reactive Elasticsearch - Could not safely identify store assignment for repository candidate interface de.muenchen.dave.repositories.relationaldb.EmailAddressRepository; If you want this repository to be a Reactive Elasticsearch repository, consider annotating your entities with one of these annotations: org.springframework.data.elasticsearch.annotations.Document (preferred), or consider extending one of the following types with your repository: org.springframework.data.elasticsearch.repository.ReactiveElasticsearchRepository 2024.03.20 16:09:33.602 | dave-backend | TraceId: | SpanId: ] | INFO | [main] | RepositoryConfigurationExtensionSupport | [RepositoryConfigurationExtensionSupport.java : 349] - Spring Data Reactive Elasticsearch - Could not safely identify store assignment for repository candidate interface de.muenchen.dave.repositories.relationaldb.DienstleisterRepository; If you want this repository to be a Reactive Elasticsearch repository, consider annotating your entities with one of these annotations: org.springframework.data.elasticsearch.annotations.Document (preferred), or consider extending one of the following types with your repository: org.springframework.data.elasticsearch.repository.ReactiveElasticsearchRepository 2024.03.20 16:09:33.604 | dave-backend | TraceId: | SpanId: ] | INFO | [main] | RepositoryConfigurationDelegate | [RepositoryConfigurationDelegate.java : 201] - Finished Spring Data repository scanning in 61 ms. Found 0 Reactive Elasticsearch repository interfaces. 2024.03.20 16:09:34.936 | dave-backend | TraceId: | SpanId: ] | INFO | [main] | GenericScope | [GenericScope.java : 283] - BeanFactory id=aa945a27-e68f-31e6-8fee-ab25cd7d347b 2024.03.20 16:09:38.098 | dave-backend | TraceId: | SpanId: ] | INFO | [main] | TomcatWebServer | [TomcatWebServer.java : 108] - Tomcat initialized with port(s): 8080 (http) 2024.03.20 16:09:38.125 | dave-backend | TraceId: | SpanId: ] | INFO | [main] | Http11NioProtocol | [DirectJDKLog.java : 173] - Initializing ProtocolHandler ["http-nio-8080"] 2024.03.20 16:09:38.127 | dave-backend | TraceId: | SpanId: ] | INFO | [main] | StandardService | [DirectJDKLog.java : 173] - Starting service [Tomcat] 2024.03.20 16:09:38.127 | dave-backend | TraceId: | SpanId: ] | INFO | [main] | StandardEngine | [DirectJDKLog.java : 173] - Starting Servlet engine: [Apache Tomcat/9.0.71] 2024.03.20 16:09:38.334 | dave-backend | TraceId: | SpanId: ] | INFO | [main] | [/] | [DirectJDKLog.java : 173] - Initializing Spring embedded WebApplicationContext 2024.03.20 16:09:38.335 | dave-backend | TraceId: | SpanId: ] | INFO | [main] | ServletWebServerApplicationContext | [ServletWebServerApplicationContext.java : 292] - Root WebApplicationContext: initialization completed in 10410 ms 2024.03.20 16:09:40.146 | dave-backend | TraceId: | SpanId: ] | WARN | [main] | HazelcastInstanceFactory | [StandardLoggerFactory.java : 56] - Hazelcast is starting in a Java modular environment (Java 9 and newer) but without proper access to required Java packages. Use additional Java arguments to provide Hazelcast access to Java internal API. The internal API access is used to get the best performance results. Arguments to be used: --add-modules java.se --add-exports java.base/jdk.internal.ref=ALL-UNNAMED --add-opens java.base/java.lang=ALL-UNNAMED --add-opens java.base/sun.nio.ch=ALL-UNNAMED --add-opens java.management/sun.management=ALL-UNNAMED --add-opens jdk.management/com.sun.management.internal=ALL-UNNAMED 2024.03.20 16:09:40.448 | dave-backend | TraceId: | SpanId: ] | INFO | [main] | logo | [StandardLoggerFactory.java : 56] - [10.138.48.190]:5701 [dave-backend-service-hazl_group] [5.1.5] + + o o o o---o o----o o o---o o o----o o--o--o + + + + | | / \ / | | / / \ | | + + + + + o----o o o o o----o | o o o o----o | + + + + | | / \ / | | \ / \ | | + + o o o o o---o o----o o----o o---o o o o----o o 2024.03.20 16:09:40.448 | dave-backend | TraceId: | SpanId: ] | INFO | [main] | system | [StandardLoggerFactory.java : 56] - [10.138.48.190]:5701 [dave-backend-service-hazl_group] [5.1.5] Copyright (c) 2008-2022, Hazelcast, Inc. All Rights Reserved. 2024.03.20 16:09:40.449 | dave-backend | TraceId: | SpanId: ] | INFO | [main] | system | [StandardLoggerFactory.java : 56] - [10.138.48.190]:5701 [dave-backend-service-hazl_group] [5.1.5] Hazelcast Platform 5.1.5 (20221114 - c52d6ff) starting at [10.138.48.190]:5701 2024.03.20 16:09:40.449 | dave-backend | TraceId: | SpanId: ] | INFO | [main] | system | [StandardLoggerFactory.java : 56] - [10.138.48.190]:5701 [dave-backend-service-hazl_group] [5.1.5] Cluster name: dave-backend-service-hazl_group 2024.03.20 16:09:40.450 | dave-backend | TraceId: | SpanId: ] | INFO | [main] | system | [StandardLoggerFactory.java : 56] - [10.138.48.190]:5701 [dave-backend-service-hazl_group] [5.1.5] Starting Integrity Check scan. This is a costly operation and it can be disabled if startup time is important. To disable Integrity Checker do one of the following: - Change member config using Java API: config.setIntegrityCheckerEnabled(false); - Change XML/YAML configuration property: Set hazelcast.integrity-checker.enabled to false - Add system property: -Dhz.integritychecker.enabled=false (for Hazelcast embedded, works only when loading config via Config.load) - Add environment variable: HZ_INTEGRITYCHECKER_ENABLED=false (recommended when running container image. For Hazelcast embedded, works only when loading config via Config.load) 2024.03.20 16:09:51.131 | dave-backend | TraceId: | SpanId: ] | INFO | [main] | system | [StandardLoggerFactory.java : 56] - [10.138.48.190]:5701 [dave-backend-service-hazl_group] [5.1.5] Integrity Check scan finished in 10680 milliseconds 2024.03.20 16:09:51.352 | dave-backend | TraceId: | SpanId: ] | INFO | [main] | system | [StandardLoggerFactory.java : 56] - [10.138.48.190]:5701 [dave-backend-service-hazl_group] [5.1.5] Integrity Check finished in 10901 milliseconds 2024.03.20 16:09:51.358 | dave-backend | TraceId: | SpanId: ] | INFO | [main] | system | [StandardLoggerFactory.java : 56] - [10.138.48.190]:5701 [dave-backend-service-hazl_group] [5.1.5] The Jet engine is disabled. To enable the Jet engine on the members, do one of the following: - Change member config using Java API: config.getJetConfig().setEnabled(true) - Change XML/YAML configuration property: Set hazelcast.jet.enabled to true - Add system property: -Dhz.jet.enabled=true (for Hazelcast embedded, works only when loading config via Config.load) - Add environment variable: HZ_JET_ENABLED=true (recommended when running container image. For Hazelcast embedded, works only when loading config via Config.load) 2024.03.20 16:09:52.543 | dave-backend | TraceId: | SpanId: ] | INFO | [main] | DiscoveryService | [StandardLoggerFactory.java : 56] - [10.138.48.190]:5701 [dave-backend-service-hazl_group] [5.1.5] Kubernetes Discovery properties: { service-dns: null, service-dns-timeout: 5, service-name: dave-backend-service, service-port: 0, service-label: null, service-label-value: true, namespace: dave-external, pod-label: null, pod-label-value: null, resolve-not-ready-addresses: true, expose-externally-mode: AUTO, use-node-name-as-external-address: false, service-per-pod-label: null, service-per-pod-label-value: null, kubernetes-api-retries: 3, kubernetes-master: https://kubernetes.default.svc} 2024.03.20 16:09:53.239 | dave-backend | TraceId: | SpanId: ] | INFO | [main] | DiscoveryService | [StandardLoggerFactory.java : 56] - [10.138.48.190]:5701 [dave-backend-service-hazl_group] [5.1.5] Kubernetes Discovery activated with mode: KUBERNETES_API 2024.03.20 16:09:53.243 | dave-backend | TraceId: | SpanId: ] | INFO | [main] | security | [StandardLoggerFactory.java : 56] - [10.138.48.190]:5701 [dave-backend-service-hazl_group] [5.1.5] Enable DEBUG/FINE log level for log category com.hazelcast.system.security or use -Dhazelcast.security.recommendations system property to see 🔒 security recommendations and the status of current config. 2024.03.20 16:09:53.446 | dave-backend | TraceId: | SpanId: ] | INFO | [main] | Node | [StandardLoggerFactory.java : 56] - [10.138.48.190]:5701 [dave-backend-service-hazl_group] [5.1.5] Using Discovery SPI 2024.03.20 16:09:53.454 | dave-backend | TraceId: | SpanId: ] | WARN | [main] | CPSubsystem | [StandardLoggerFactory.java : 56] - [10.138.48.190]:5701 [dave-backend-service-hazl_group] [5.1.5] CP Subsystem is not enabled. CP data structures will operate in UNSAFE mode! Please note that UNSAFE mode will not provide strong consistency guarantees. 2024.03.20 16:09:54.407 | dave-backend | TraceId: | SpanId: ] | INFO | [main] | Diagnostics | [StandardLoggerFactory.java : 56] - [10.138.48.190]:5701 [dave-backend-service-hazl_group] [5.1.5] Diagnostics disabled. To enable add -Dhazelcast.diagnostics.enabled=true to the JVM arguments. 2024.03.20 16:09:54.425 | dave-backend | TraceId: | SpanId: ] | INFO | [main] | LifecycleService | [StandardLoggerFactory.java : 56] - [10.138.48.190]:5701 [dave-backend-service-hazl_group] [5.1.5] [10.138.48.190]:5701 is STARTING 2024.03.20 16:09:54.626 | dave-backend | TraceId: | SpanId: ] | INFO | [main] | DiscoveryService | [StandardLoggerFactory.java : 56] - [10.138.48.190]:5701 [dave-backend-service-hazl_group] [5.1.5] Cannot fetch the current zone, ZONE_AWARE feature is disabled 2024.03.20 16:09:54.790 | dave-backend | TraceId: | SpanId: ] | WARN | [main] | DiscoveryService | [StandardLoggerFactory.java : 56] - [10.138.48.190]:5701 [dave-backend-service-hazl_group] [5.1.5] Cannot fetch name of the node, NODE_AWARE feature is disabled 2024.03.20 16:09:54.820 | dave-backend | TraceId: | SpanId: ] | WARN | [main] | KubernetesClient | [StandardLoggerFactory.java : 56] - Kubernetes API access is forbidden! Starting standalone. To use Hazelcast Kubernetes discovery, configure the required RBAC. For 'default' service account in 'default' namespace execute: `kubectl apply -f https://raw.githubusercontent.com/hazelcast/hazelcast/master/kubernetes-rbac.yaml` 2024.03.20 16:09:59.853 | dave-backend | TraceId: | SpanId: ] | INFO | [main] | ClusterService | [StandardLoggerFactory.java : 56] - [10.138.48.190]:5701 [dave-backend-service-hazl_group] [5.1.5] Members {size:1, ver:1} [ Member [10.138.48.190]:5701 - cb4bf69c-ebad-4e4d-adb2-6a0cb3ce7977 this ] 2024.03.20 16:09:59.882 | dave-backend | TraceId: | SpanId: ] | INFO | [main] | LifecycleService | [StandardLoggerFactory.java : 56] - [10.138.48.190]:5701 [dave-backend-service-hazl_group] [5.1.5] [10.138.48.190]:5701 is STARTED 2024.03.20 16:10:01.217 | dave-backend | TraceId: | SpanId: ] | DEBUG | [main] | ForwardedHeaderFilter | [GenericFilterBean.java : 242] - Filter 'forwardedHeaderFilter' configured for use 2024.03.20 16:10:01.218 | dave-backend | TraceId: | SpanId: ] | DEBUG | [main] | RequestResponseLoggingFilter | [RequestResponseLoggingFilter.java : 51] - Initializing filter: de.muenchen.dave.security.RequestResponseLoggingFilter@235b4cb8 2024.03.20 16:10:01.222 | dave-backend | TraceId: | SpanId: ] | DEBUG | [main] | CacheControlConfiguration$CacheControlFilter | [GenericFilterBean.java : 242] - Filter 'cacheControlFilter' configured for use 2024.03.20 16:10:01.224 | dave-backend | TraceId: | SpanId: ] | DEBUG | [main] | ShallowEtagHeaderFilter | [GenericFilterBean.java : 242] - Filter 'shallowEtagHeaderFilter' configured for use 2024.03.20 16:10:04.938 | dave-backend | TraceId: | SpanId: ] | INFO | [main] | LogHelper | [LogHelper.java : 31] - HHH000204: Processing PersistenceUnitInfo [name: default] 2024.03.20 16:10:05.060 | dave-backend | TraceId: | SpanId: ] | INFO | [main] | Version | [Version.java : 44] - HHH000412: Hibernate ORM core version 5.6.14.Final 2024.03.20 16:10:05.663 | dave-backend | TraceId: | SpanId: ] | INFO | [main] | Version | [JavaReflectionManager.java : 56] - HCANN000001: Hibernate Commons Annotations {5.1.2.Final} 2024.03.20 16:10:05.953 | dave-backend | TraceId: | SpanId: ] | INFO | [main] | HikariDataSource | [HikariDataSource.java : 110] - HikariPool-1 - Starting... 2024.03.20 16:10:06.500 | dave-backend | TraceId: | SpanId: ] | INFO | [main] | HikariDataSource | [HikariDataSource.java : 123] - HikariPool-1 - Start completed. 2024.03.20 16:10:06.542 | dave-backend | TraceId: | SpanId: ] | INFO | [main] | Dialect | [Dialect.java : 175] - HHH000400: Using dialect: org.hibernate.dialect.PostgreSQL95Dialect 2024.03.20 16:10:09.157 | dave-backend | TraceId: | SpanId: ] | INFO | [main] | JtaPlatformInitiator | [JtaPlatformInitiator.java : 52] - HHH000490: Using JtaPlatform implementation: [org.hibernate.engine.transaction.jta.platform.internal.NoJtaPlatform] 2024.03.20 16:10:09.173 | dave-backend | TraceId: | SpanId: ] | INFO | [main] | LocalContainerEntityManagerFactoryBean | [AbstractEntityManagerFactoryBean.java : 437] - Initialized JPA EntityManagerFactory for persistence unit 'default' WARNING: An illegal reflective access operation has occurred WARNING: Illegal reflective access by org.springframework.util.ReflectionUtils (jar:file:/deployments/spring-boot-application.jar!/BOOT-INF/lib/spring-core-5.3.25.jar!/) to field java.math.BigDecimal.intVal WARNING: Please consider reporting this to the maintainers of org.springframework.util.ReflectionUtils WARNING: Use --illegal-access=warn to enable warnings of further illegal reflective access operations WARNING: All illegal access operations will be denied in a future release 2024.03.20 16:10:11.445 | dave-backend | TraceId: | SpanId: ] | TRACE | [main] | AnnotationCacheOperationSource | [AbstractFallbackCacheOperationSource.java : 102] - Adding cacheable method 'delete' with attribute: [Builder[public final void com.sun.proxy.$Proxy234.delete(de.muenchen.dave.domain.elasticsearch.Zaehlstelle)] caches=[SUCHE_ZAEHLSTELLE, SUCHE_ZAEHLSTELLE_DATENPORTAL, LADE_BELASTUNGSPLAN_DTO, LADE_PROCESSED_ZAEHLDATEN, LADE_ZAEHLDATEN_ZEITREIHE_DTO, READ_ZAEHLSTELLE_DTO] | key='' | keyGenerator='' | cacheManager='' | cacheResolver='' | condition='',true,false] 2024.03.20 16:10:11.508 | dave-backend | TraceId: | SpanId: ] | TRACE | [main] | AnnotationCacheOperationSource | [AbstractFallbackCacheOperationSource.java : 102] - Adding cacheable method 'readZaehlstelleDTO' with attribute: [Builder[public de.muenchen.dave.domain.dtos.LeseZaehlstelleDTO de.muenchen.dave.services.IndexService.readZaehlstelleDTO(java.lang.String,boolean) throws de.muenchen.dave.exceptions.DataNotFoundException] caches=[READ_ZAEHLSTELLE_DTO] | key='{#p0, #p1}' | keyGenerator='' | cacheManager='' | cacheResolver='' | condition='' | unless='' | sync='false'] 2024.03.20 16:10:11.974 | dave-backend | TraceId: | SpanId: ] | INFO | [main] | KIService | [KIService.java : 65] - Successfully created ONNX session 2024.03.20 16:10:12.858 | dave-backend | TraceId: | SpanId: ] | TRACE | [main] | AnnotationCacheOperationSource | [AbstractFallbackCacheOperationSource.java : 102] - Adding cacheable method 'getZeitreiheDTO' with attribute: [Builder[public de.muenchen.dave.domain.dtos.laden.LadeZaehldatenZeitreiheDTO de.muenchen.dave.services.processzaehldaten.ProcessZaehldatenZeitreiheService.getZeitreiheDTO(java.lang.String,java.lang.String,de.muenchen.dave.domain.dtos.OptionsDTO) throws de.muenchen.dave.exceptions.DataNotFoundException] caches=[LADE_ZAEHLDATEN_ZEITREIHE_DTO] | key='{#p0, #p1, #p2}' | keyGenerator='' | cacheManager='' | cacheResolver='' | condition='' | unless='' | sync='false'] 2024.03.20 16:10:12.914 | dave-backend | TraceId: | SpanId: ] | INFO | [main] | GeneratePdfService | [GeneratePdfService.java : 268] - initialisiere die Templates 2024.03.20 16:10:13.029 | dave-backend | TraceId: | SpanId: ] | TRACE | [main] | AnnotationCacheOperationSource | [AbstractFallbackCacheOperationSource.java : 102] - Adding cacheable method 'ladeProcessedZaehldaten' with attribute: [Builder[public de.muenchen.dave.domain.dtos.laden.LadeProcessedZaehldatenDTO de.muenchen.dave.services.processzaehldaten.ProcessZaehldatenService.ladeProcessedZaehldaten(java.lang.String,de.muenchen.dave.domain.dtos.OptionsDTO) throws de.muenchen.dave.exceptions.DataNotFoundException] caches=[LADE_PROCESSED_ZAEHLDATEN] | key='{#p0, #p1}' | keyGenerator='' | cacheManager='' | cacheResolver='' | condition='' | unless='' | sync='false'] 2024.03.20 16:10:13.041 | dave-backend | TraceId: | SpanId: ] | INFO | [main] | ReportService | [ReportService.java : 188] - initialisiere die Report Templates 2024.03.20 16:10:13.325 | dave-backend | TraceId: | SpanId: ] | TRACE | [main] | AnnotationCacheOperationSource | [AbstractFallbackCacheOperationSource.java : 102] - Adding cacheable method 'sucheZaehlstelleSichtbarDatenportal' with attribute: [Builder[public java.util.Set de.muenchen.dave.services.SucheService.sucheZaehlstelleSichtbarDatenportal(java.lang.String,boolean)] caches=[SUCHE_ZAEHLSTELLE_DATENPORTAL] | key='{#p0, #p1}' | keyGenerator='' | cacheManager='' | cacheResolver='' | condition='' | unless='' | sync='false'] 2024.03.20 16:10:13.331 | dave-backend | TraceId: | SpanId: ] | TRACE | [main] | AnnotationCacheOperationSource | [AbstractFallbackCacheOperationSource.java : 102] - Adding cacheable method 'sucheZaehlstelle' with attribute: [Builder[public java.util.Set de.muenchen.dave.services.SucheService.sucheZaehlstelle(java.lang.String,boolean)] caches=[SUCHE_ZAEHLSTELLE] | key='{#p0, #p1}' | keyGenerator='' | cacheManager='' | cacheResolver='' | condition='' | unless='' | sync='false'] 2024.03.20 16:10:13.453 | dave-backend | TraceId: | SpanId: ] | TRACE | [main] | AnnotationCacheOperationSource | [AbstractFallbackCacheOperationSource.java : 102] - Adding cacheable method 'getBelastungsplanDTO' with attribute: [Builder[public de.muenchen.dave.domain.dtos.laden.LadeBelastungsplanDTO de.muenchen.dave.services.processzaehldaten.ProcessZaehldatenBelastungsplanService.getBelastungsplanDTO(java.lang.String,de.muenchen.dave.domain.dtos.OptionsDTO) throws de.muenchen.dave.exceptions.DataNotFoundException] caches=[LADE_BELASTUNGSPLAN_DTO] | key='{#p0, #p1}' | keyGenerator='' | cacheManager='' | cacheResolver='' | condition='' | unless='' | sync='false'] 2024.03.20 16:10:13.634 | dave-backend | TraceId: | SpanId: ] | TRACE | [main] | AnnotationCacheOperationSource | [AbstractFallbackCacheOperationSource.java : 102] - Adding cacheable method 'loadAuthentication' with attribute: [Builder[public org.springframework.security.oauth2.provider.OAuth2Authentication de.muenchen.dave.security.CustomUserInfoTokenServices.loadAuthentication(java.lang.String)] caches=[authentication_cache] | key='' | keyGenerator='' | cacheManager='' | cacheResolver='' | condition='' | unless='' | sync='false'] 2024.03.20 16:10:15.095 | dave-backend | TraceId: | SpanId: ] | INFO | [main] | DefaultSecurityFilterChain | [DefaultSecurityFilterChain.java : 55] - Will secure Ant [pattern='/**'] with [org.springframework.security.web.session.DisableEncodeUrlFilter@15bb8ed5, org.springframework.security.web.context.request.async.WebAsyncManagerIntegrationFilter@18f8ebd4, org.springframework.security.web.context.SecurityContextPersistenceFilter@652f26da, org.springframework.security.web.header.HeaderWriterFilter@5f781173, org.springframework.security.web.csrf.CsrfFilter@2db3675a, org.springframework.security.web.authentication.logout.LogoutFilter@16c0be3b, org.springframework.security.oauth2.server.resource.web.BearerTokenAuthenticationFilter@2a5d2041, org.springframework.security.web.savedrequest.RequestCacheAwareFilter@3acc3ee, org.springframework.security.web.servletapi.SecurityContextHolderAwareRequestFilter@1f293cb7, org.springframework.security.web.authentication.AnonymousAuthenticationFilter@7e1fb22c, org.springframework.security.web.session.SessionManagementFilter@65a2755e, org.springframework.security.web.access.ExceptionTranslationFilter@1fcc3461, org.springframework.security.web.access.intercept.FilterSecurityInterceptor@4c5e4bfa] 2024.03.20 16:10:15.835 | dave-backend | TraceId: | SpanId: ] | WARN | [main] | JpaBaseConfiguration$JpaWebConfiguration | [JpaBaseConfiguration.java : 219] - spring.jpa.open-in-view is enabled by default. Therefore, database queries may be performed during view rendering. Explicitly configure spring.jpa.open-in-view to disable this warning 2024.03.20 16:10:17.655 | dave-backend | TraceId: | SpanId: ] | DEBUG | [main] | RequestMappingHandlerAdapter | [RequestMappingHandlerAdapter.java : 625] - ControllerAdvice beans: 0 @ModelAttribute, 0 @InitBinder, 1 RequestBodyAdvice, 1 ResponseBodyAdvice 2024.03.20 16:10:18.060 | dave-backend | TraceId: | SpanId: ] | DEBUG | [main] | RequestMappingHandlerMapping | [AbstractHandlerMethodMapping.java : 367] - 48 mappings in 'requestMappingHandlerMapping' 2024.03.20 16:10:18.244 | dave-backend | TraceId: | SpanId: ] | DEBUG | [main] | SimpleUrlHandlerMapping | [SimpleUrlHandlerMapping.java : 188] - Patterns [/webjars/**, /**, /explorer/**] in 'resourceHandlerMapping' 2024.03.20 16:10:18.309 | dave-backend | TraceId: | SpanId: ] | DEBUG | [main] | ExceptionHandlerExceptionResolver | [ExceptionHandlerExceptionResolver.java : 307] - ControllerAdvice beans: 1 @ExceptionHandler, 1 ResponseBodyAdvice 2024.03.20 16:10:19.227 | dave-backend | TraceId: | SpanId: ] | INFO | [main] | PartitionStateManager | [StandardLoggerFactory.java : 56] - [10.138.48.190]:5701 [dave-backend-service-hazl_group] [5.1.5] Initializing cluster partition table arrangement... 2024.03.20 16:10:21.314 | dave-backend | TraceId: | SpanId: ] | INFO | [main] | EndpointLinksResolver | [EndpointLinksResolver.java : 58] - Exposing 3 endpoint(s) beneath base path '/actuator' 2024.03.20 16:10:21.539 | dave-backend | TraceId: | SpanId: ] | INFO | [main] | Http11NioProtocol | [DirectJDKLog.java : 173] - Starting ProtocolHandler ["http-nio-8080"] 2024.03.20 16:10:21.591 | dave-backend | TraceId: | SpanId: ] | INFO | [main] | TomcatWebServer | [TomcatWebServer.java : 220] - Tomcat started on port(s): 8080 (http) with context path '' 2024.03.20 16:10:21.645 | dave-backend | TraceId: | SpanId: ] | INFO | [main] | DaveBackendApplication | [StartupInfoLogger.java : 61] - Started DaveBackendApplication in 56.427 seconds (JVM running for 58.499) 2024.03.20 16:10:21.716 | dave-backend | TraceId: 1a57005ec9c6cb34 | SpanId: 1a57005ec9c6cb34] | DEBUG | [scheduling-1] | EmailReceiveService | [EmailReceiveService.java : 73] - Scheduler EmailReceiveService: Check nach neuen E-Mails im Postfach dave-dev@muenchen.de 2024.03.20 16:10:52.364 | dave-backend | TraceId: 52374078715e1c3e | SpanId: 52374078715e1c3e] | DEBUG | [scheduling-1] | EmailReceiveService | [EmailReceiveService.java : 73] - Scheduler EmailReceiveService: Check nach neuen E-Mails im Postfach dave-dev@muenchen.de 2024.03.20 16:11:22.760 | dave-backend | TraceId: b434e3c5e327ce8d | SpanId: b434e3c5e327ce8d] | DEBUG | [scheduling-1] | EmailReceiveService | [EmailReceiveService.java : 73] - Scheduler EmailReceiveService: Check nach neuen E-Mails im Postfach dave-dev@muenchen.de 2024.03.20 16:11:53.181 | dave-backend | TraceId: 2973d62832bb5009 | SpanId: 2973d62832bb5009] | DEBUG | [scheduling-1] | EmailReceiveService | [EmailReceiveService.java : 73] - Scheduler EmailReceiveService: Check nach neuen E-Mails im Postfach dave-dev@muenchen.de 2024.03.20 16:12:23.602 | dave-backend | TraceId: 703732a084441f54 | SpanId: 703732a084441f54] | DEBUG | [scheduling-1] | EmailReceiveService | [EmailReceiveService.java : 73] - Scheduler EmailReceiveService: Check nach neuen E-Mails im Postfach dave-dev@muenchen.de 2024.03.20 16:12:54.006 | dave-backend | TraceId: 3cfee771f495aa21 | SpanId: 3cfee771f495aa21] | DEBUG | [scheduling-1] | EmailReceiveService | [EmailReceiveService.java : 73] - Scheduler EmailReceiveService: Check nach neuen E-Mails im Postfach dave-dev@muenchen.de 2024.03.20 16:13:24.418 | dave-backend | TraceId: 498b4d82f0acc2a4 | SpanId: 498b4d82f0acc2a4] | DEBUG | [scheduling-1] | EmailReceiveService | [EmailReceiveService.java : 73] - Scheduler EmailReceiveService: Check nach neuen E-Mails im Postfach dave-dev@muenchen.de 2024.03.20 16:13:54.831 | dave-backend | TraceId: 1c6730860b06e8c7 | SpanId: 1c6730860b06e8c7] | DEBUG | [scheduling-1] | EmailReceiveService | [EmailReceiveService.java : 73] - Scheduler EmailReceiveService: Check nach neuen E-Mails im Postfach dave-dev@muenchen.de 2024.03.20 16:14:25.255 | dave-backend | TraceId: 6414cb4bf47ae491 | SpanId: 6414cb4bf47ae491] | DEBUG | [scheduling-1] | EmailReceiveService | [EmailReceiveService.java : 73] - Scheduler EmailReceiveService: Check nach neuen E-Mails im Postfach dave-dev@muenchen.de 2024.03.20 16:14:55.649 | dave-backend | TraceId: abb01437e5e65586 | SpanId: abb01437e5e65586] | DEBUG | [scheduling-1] | EmailReceiveService | [EmailReceiveService.java : 73] - Scheduler EmailReceiveService: Check nach neuen E-Mails im Postfach dave-dev@muenchen.de 2024.03.20 16:15:26.074 | dave-backend | TraceId: d1be7d260f683b01 | SpanId: d1be7d260f683b01] | DEBUG | [scheduling-1] | EmailReceiveService | [EmailReceiveService.java : 73] - Scheduler EmailReceiveService: Check nach neuen E-Mails im Postfach dave-dev@muenchen.de 2024.03.20 16:15:56.554 | dave-backend | TraceId: 0666f9af9d98a43e | SpanId: 0666f9af9d98a43e] | DEBUG | [scheduling-1] | EmailReceiveService | [EmailReceiveService.java : 73] - Scheduler EmailReceiveService: Check nach neuen E-Mails im Postfach dave-dev@muenchen.de 2024.03.20 16:16:26.960 | dave-backend | TraceId: 4295ca4b7cadd6e4 | SpanId: 4295ca4b7cadd6e4] | DEBUG | [scheduling-1] | EmailReceiveService | [EmailReceiveService.java : 73] - Scheduler EmailReceiveService: Check nach neuen E-Mails im Postfach dave-dev@muenchen.de 2024.03.20 16:16:57.371 | dave-backend | TraceId: 3dcebf858c187085 | SpanId: 3dcebf858c187085] | DEBUG | [scheduling-1] | EmailReceiveService | [EmailReceiveService.java : 73] - Scheduler EmailReceiveService: Check nach neuen E-Mails im Postfach dave-dev@muenchen.de 2024.03.20 16:17:27.758 | dave-backend | TraceId: 8fdef0b84a0e7a1a | SpanId: 8fdef0b84a0e7a1a] | DEBUG | [scheduling-1] | EmailReceiveService | [EmailReceiveService.java : 73] - Scheduler EmailReceiveService: Check nach neuen E-Mails im Postfach dave-dev@muenchen.de 2024.03.20 16:17:58.150 | dave-backend | TraceId: 2a6901cd0d33ee6f | SpanId: 2a6901cd0d33ee6f] | DEBUG | [scheduling-1] | EmailReceiveService | [EmailReceiveService.java : 73] - Scheduler EmailReceiveService: Check nach neuen E-Mails im Postfach dave-dev@muenchen.de 2024.03.20 16:18:28.532 | dave-backend | TraceId: 9680d0c09b2b6b73 | SpanId: 9680d0c09b2b6b73] | DEBUG | [scheduling-1] | EmailReceiveService | [EmailReceiveService.java : 73] - Scheduler EmailReceiveService: Check nach neuen E-Mails im Postfach dave-dev@muenchen.de 2024.03.20 16:18:58.928 | dave-backend | TraceId: c91758c9979761d9 | SpanId: c91758c9979761d9] | DEBUG | [scheduling-1] | EmailReceiveService | [EmailReceiveService.java : 73] - Scheduler EmailReceiveService: Check nach neuen E-Mails im Postfach dave-dev@muenchen.de 2024.03.20 16:19:29.314 | dave-backend | TraceId: 938b233abda56ffa | SpanId: 938b233abda56ffa] | DEBUG | [scheduling-1] | EmailReceiveService | [EmailReceiveService.java : 73] - Scheduler EmailReceiveService: Check nach neuen E-Mails im Postfach dave-dev@muenchen.de 2024.03.20 16:19:59.682 | dave-backend | TraceId: af60465c6b1c2ffe | SpanId: af60465c6b1c2ffe] | DEBUG | [scheduling-1] | EmailReceiveService | [EmailReceiveService.java : 73] - Scheduler EmailReceiveService: Check nach neuen E-Mails im Postfach dave-dev@muenchen.de 2024.03.20 16:20:00.101 | dave-backend | TraceId: 20200cf77da0698d | SpanId: 20200cf77da0698d] | DEBUG | [scheduling-1] | ZaehlungStatusUpdater | [ZaehlungStatusUpdater.java : 23] - Scheduler ZaehlungStatusUpdater start 2024.03.20 16:20:00.809 | dave-backend | TraceId: | SpanId: ] | ERROR | [scheduling-1] | TaskUtils$LoggingErrorHandler | [TaskUtils.java : 95] - Unexpected error occurred in scheduled task org.springframework.data.elasticsearch.RestStatusException: Elasticsearch exception [type=search_phase_execution_exception, reason=all shards failed]; nested exception is ElasticsearchStatusException[Elasticsearch exception [type=search_phase_execution_exception, reason=all shards failed]] at org.springframework.data.elasticsearch.core.ElasticsearchExceptionTranslator.translateExceptionIfPossible(ElasticsearchExceptionTranslator.java:69) at org.springframework.data.elasticsearch.core.ElasticsearchRestTemplate.translateException(ElasticsearchRestTemplate.java:601) at org.springframework.data.elasticsearch.core.ElasticsearchRestTemplate.execute(ElasticsearchRestTemplate.java:584) at org.springframework.data.elasticsearch.core.ElasticsearchRestTemplate.count(ElasticsearchRestTemplate.java:393) at org.springframework.data.elasticsearch.repository.query.AbstractElasticsearchRepositoryQuery.execute(AbstractElasticsearchRepositoryQuery.java:108) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137) at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java:160) at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:215) at com.sun.proxy.$Proxy234.findAllByZaehlungenStatus(Unknown Source) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.base/java.lang.reflect.Method.invoke(Method.java:566) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:208) at com.sun.proxy.$Proxy234.findAllByZaehlungenStatus(Unknown Source) at de.muenchen.dave.services.IndexService.updateStatusOfInstrucedZaehlungen(IndexService.java:713) at de.muenchen.dave.services.IndexService$$FastClassBySpringCGLIB$$5c3a2173.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at de.muenchen.dave.services.IndexService$$EnhancerBySpringCGLIB$$4f31ade0.updateStatusOfInstrucedZaehlungen() at de.muenchen.dave.services.persist.InternalZaehlungPersistierungsService.updateStatusOfInstrucedZaehlungen(InternalZaehlungPersistierungsService.java:333) at de.muenchen.dave.services.persist.InternalZaehlungPersistierungsService$$FastClassBySpringCGLIB$$88c774fb.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704) at de.muenchen.dave.services.persist.InternalZaehlungPersistierungsService$$EnhancerBySpringCGLIB$$227ecea6.updateStatusOfInstrucedZaehlungen() at de.muenchen.dave.scheduler.ZaehlungStatusUpdater.updateStatus(ZaehlungStatusUpdater.java:25) at de.muenchen.dave.scheduler.ZaehlungStatusUpdater$$FastClassBySpringCGLIB$$7864c0f8.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.aspectj.MethodInvocationProceedingJoinPoint.proceed(MethodInvocationProceedingJoinPoint.java:89) at org.springframework.cloud.sleuth.instrument.scheduling.TraceSchedulingAspect.traceBackgroundThread(TraceSchedulingAspect.java:70) at jdk.internal.reflect.GeneratedMethodAccessor109.invoke(Unknown Source) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.base/java.lang.reflect.Method.invoke(Method.java:566) at org.springframework.aop.aspectj.AbstractAspectJAdvice.invokeAdviceMethodWithGivenArgs(AbstractAspectJAdvice.java:634) at org.springframework.aop.aspectj.AbstractAspectJAdvice.invokeAdviceMethod(AbstractAspectJAdvice.java:624) at org.springframework.aop.aspectj.AspectJAroundAdvice.invoke(AspectJAroundAdvice.java:72) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:708) at de.muenchen.dave.scheduler.ZaehlungStatusUpdater$$EnhancerBySpringCGLIB$$26f96d23.updateStatus() at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.base/java.lang.reflect.Method.invoke(Method.java:566) at org.springframework.scheduling.support.ScheduledMethodRunnable.run(ScheduledMethodRunnable.java:84) at org.springframework.scheduling.support.DelegatingErrorHandlingRunnable.run(DelegatingErrorHandlingRunnable.java:54) at org.springframework.scheduling.concurrent.ReschedulingRunnable.run(ReschedulingRunnable.java:95) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515) at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) at java.base/java.lang.Thread.run(Thread.java:829) Caused by: org.elasticsearch.ElasticsearchStatusException: Elasticsearch exception [type=search_phase_execution_exception, reason=all shards failed] at org.elasticsearch.rest.BytesRestResponse.errorFromXContent(BytesRestResponse.java:178) at org.elasticsearch.client.RestHighLevelClient.parseEntity(RestHighLevelClient.java:2484) at org.elasticsearch.client.RestHighLevelClient.parseResponseException(RestHighLevelClient.java:2461) at org.elasticsearch.client.RestHighLevelClient.internalPerformRequest(RestHighLevelClient.java:2184) at org.elasticsearch.client.RestHighLevelClient.performRequest(RestHighLevelClient.java:2137) at org.elasticsearch.client.RestHighLevelClient.performRequestAndParseEntity(RestHighLevelClient.java:2105) at org.elasticsearch.client.RestHighLevelClient.search(RestHighLevelClient.java:1367) at org.springframework.data.elasticsearch.core.ElasticsearchRestTemplate.lambda$count$13(ElasticsearchRestTemplate.java:393) at org.springframework.data.elasticsearch.core.ElasticsearchRestTemplate.execute(ElasticsearchRestTemplate.java:582) ... 68 common frames omitted Suppressed: org.elasticsearch.client.ResponseException: method [POST], host [http://dave-elasticsearch:9200], URI [/zaehlstelle/_search?typed_keys=true&max_concurrent_shard_requests=5&search_type=query_then_fetch&batched_reduce_size=512], status line [HTTP/1.1 503 Service Unavailable] {"error":{"root_cause":[{"type":"no_shard_available_action_exception","reason":null}],"type":"search_phase_execution_exception","reason":"all shards failed","phase":"query","grouped":true,"failed_shards":[{"shard":0,"index":"zaehlstelle","node":null,"reason":{"type":"no_shard_available_action_exception","reason":null}}]},"status":503} at org.elasticsearch.client.RestClient.convertResponse(RestClient.java:347) at org.elasticsearch.client.RestClient.performRequest(RestClient.java:313) at org.elasticsearch.client.RestClient.performRequest(RestClient.java:288) at org.elasticsearch.client.RestHighLevelClient.performClientRequest(RestHighLevelClient.java:2699) at org.elasticsearch.client.RestHighLevelClient.internalPerformRequest(RestHighLevelClient.java:2171) ... 73 common frames omitted 2024.03.20 16:20:30.096 | dave-backend | TraceId: 51fb8b9d3a2a58aa | SpanId: 51fb8b9d3a2a58aa] | DEBUG | [scheduling-1] | EmailReceiveService | [EmailReceiveService.java : 73] - Scheduler EmailReceiveService: Check nach neuen E-Mails im Postfach dave-dev@muenchen.de 2024.03.20 16:21:00.518 | dave-backend | TraceId: 40e7bb7796b72179 | SpanId: 40e7bb7796b72179] | DEBUG | [scheduling-1] | EmailReceiveService | [EmailReceiveService.java : 73] - Scheduler EmailReceiveService: Check nach neuen E-Mails im Postfach dave-dev@muenchen.de 2024.03.20 16:21:31.035 | dave-backend | TraceId: de32606b279b082c | SpanId: de32606b279b082c] | DEBUG | [scheduling-1] | EmailReceiveService | [EmailReceiveService.java : 73] - Scheduler EmailReceiveService: Check nach neuen E-Mails im Postfach dave-dev@muenchen.de 2024.03.20 16:22:01.431 | dave-backend | TraceId: e41b94d7b0353fb7 | SpanId: e41b94d7b0353fb7] | DEBUG | [scheduling-1] | EmailReceiveService | [EmailReceiveService.java : 73] - Scheduler EmailReceiveService: Check nach neuen E-Mails im Postfach dave-dev@muenchen.de 2024.03.20 16:22:31.829 | dave-backend | TraceId: f9848e94b87dd21b | SpanId: f9848e94b87dd21b] | DEBUG | [scheduling-1] | EmailReceiveService | [EmailReceiveService.java : 73] - Scheduler EmailReceiveService: Check nach neuen E-Mails im Postfach dave-dev@muenchen.de ```

Dave-backend stürzt nicht mehr ab, findet aber anscheinend elasticsearch nicht (?)

Elasticsearch ist aber vom dave-backend Pod aus erreichbar:

sh-4.4$ curl dave-elasticsearch:9200
{
  "name" : "dave-elasticsearch-master-0",
  "cluster_name" : "elastic",
  "cluster_uuid" : "9Iq6qSlUQDuWTtTrm4g86g",
  "version" : {
    "number" : "8.12.0",
    "build_flavor" : "default",
    "build_type" : "tar",
    "build_hash" : "1665f706fd9354802c02146c1e6b5c0fbcddfbc9",
    "build_date" : "2024-01-11T10:05:27.953830042Z",
    "build_snapshot" : false,
    "lucene_version" : "9.9.1",
    "minimum_wire_compatibility_version" : "7.17.0",
    "minimum_index_compatibility_version" : "7.0.0"
  },
  "tagline" : "You Know, for Search"
}
sh-4.4$ curl http://dave-elasticsearch:9200
{
  "name" : "dave-elasticsearch-master-0",
  "cluster_name" : "elastic",
  "cluster_uuid" : "9Iq6qSlUQDuWTtTrm4g86g",
  "version" : {
    "number" : "8.12.0",
    "build_flavor" : "default",
    "build_type" : "tar",
    "build_hash" : "1665f706fd9354802c02146c1e6b5c0fbcddfbc9",
    "build_date" : "2024-01-11T10:05:27.953830042Z",
    "build_snapshot" : false,
    "lucene_version" : "9.9.1",
    "minimum_wire_compatibility_version" : "7.17.0",
    "minimum_index_compatibility_version" : "7.0.0"
  },
  "tagline" : "You Know, for Search"
}
sh-4.4$

@DanielOber Kannst du helfen?

gislab-augsburg commented 8 months ago

Das gleiche bei ELASTICSEARCH_HOST: dave-elasticsearch-master-hl

gislab-augsburg commented 8 months ago

Änderung des elasticsearch passworts auf default "" ändert auch nichts: a4f3653e45ac5960720951fba4a90442f55006c4

gislab-augsburg commented 7 months ago

siehe #18