StarRocks / starrocks

The world's fastest open query engine for sub-second analytics both on and off the data lakehouse. With the flexibility to support nearly any scenario, StarRocks provides best-in-class performance for multi-dimensional analytics, real-time analytics, and ad-hoc queries. A Linux Foundation project.
https://starrocks.io
Apache License 2.0
8.91k stars 1.79k forks source link

hive catalog meta data refresh bug #42410

Closed dickson-bit closed 1 month ago

dickson-bit commented 8 months ago

fe.log 2024-03-11 00:00:01,022 ERROR (starrocks-taskrun-pool-2577|719986) [HiveMetaClient.callRPC():162] Failed to get table [mysql_prod_enlightent_daily.animation_total_heat [Host]> java.lang.reflect.InvocationTargetException: null 3 at jdk.internal.reflect.GeneratedMethodAccessor6.invoke(Unknown Source) ~[?:?] 4 at jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:?] 5 at java.lang.reflect.Method.invoke(Method.java:566) ~[?:?] 6 at com.starrocks.connector.hive.HiveMetaClient.callRPC(HiveMetaClient.java:160) ~[starrocks-fe.jar:?] 7 at com.starrocks.connector.hive.HiveMetaClient.callRPC(HiveMetaClient.java:149) ~[starrocks-fe.jar:?] 8 at com.starrocks.connector.hive.HiveMetaClient.getTable(HiveMetaClient.java:257) ~[starrocks-fe.jar:?] 9 at com.starrocks.connector.hive.HiveMetastore.getTable(HiveMetastore.java:110) ~[starrocks-fe.jar:?] 10 at com.starrocks.connector.hive.CachingHiveMetastore.loadTable(CachingHiveMetastore.java:300) ~[starrocks-fe.jar:?] 11 at com.starrocks.connector.hive.CachingHiveMetastore.refreshTableWithoutSync(CachingHiveMetastore.java:490) ~[starrocks-fe.jar:?] 12 at com.starrocks.connector.hive.CachingHiveMetastore.refreshTable(CachingHiveMetastore.java:457) ~[starrocks-fe.jar:?] 13 at com.starrocks.connector.hive.CacheUpdateProcessor.refreshTable(CacheUpdateProcessor.java:96) ~[starrocks-fe.jar:?] 14 at com.starrocks.connector.hive.HiveMetadata.lambda$refreshTable$3(HiveMetadata.java:289) ~[starrocks-fe.jar:?] 15 at java.util.Optional.ifPresent(Optional.java:183) ~[?:?] 16 at com.starrocks.connector.hive.HiveMetadata.refreshTable(HiveMetadata.java:289) ~[starrocks-fe.jar:?] 17 at com.starrocks.connector.CatalogConnectorMetadata.refreshTable(CatalogConnectorMetadata.java:154) ~[starrocks-fe.jar:?] 18 at com.starrocks.server.MetadataMgr.lambda$refreshTable$8(MetadataMgr.java:463) ~[starrocks-fe.jar:?] 19 at java.util.Optional.ifPresent(Optional.java:183) ~[?:?] 20 at com.starrocks.server.MetadataMgr.refreshTable(MetadataMgr.java:463) ~[starrocks-fe.jar:?] 21 at com.starrocks.scheduler.PartitionBasedMvRefreshProcessor.refreshExternalTable(PartitionBasedMvRefreshProcessor.java:560) ~[starrocks-fe.jar:?] 22 at com.starrocks.scheduler.PartitionBasedMvRefreshProcessor.doMvRefresh(PartitionBasedMvRefreshProcessor.java:216) ~[starrocks-fe.jar:?] 23 at com.starrocks.scheduler.PartitionBasedMvRefreshProcessor.processTaskRun(PartitionBasedMvRefreshProcessor.java:194) ~[starrocks-fe.jar:?] 24 at com.starrocks.scheduler.TaskRun.executeTaskRun(TaskRun.java:214) ~[starrocks-fe.jar:?] 25 at com.starrocks.scheduler.TaskRunExecutor.lambda$executeTaskRun$0(TaskRunExecutor.java:53) ~[starrocks-fe.jar:?] 26 at java.util.concurrent.CompletableFuture$AsyncSupply.run(CompletableFuture.java:1700) ~[?:?] 27 at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) ~[?:?] 28 at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) ~[?:?] 29 at java.lang.Thread.run(Thread.java:834) ~[?:?] 30 Caused by: java.lang.StackOverflowError 31 at java.util.Collections$UnmodifiableList.get(Collections.java:1308) ~[?:?] 32 at java.util.Collections$UnmodifiableList.get(Collections.java:1308) ~[?:?] 33 at java.util.Collections$UnmodifiableList.get(Collections.java:1308) ~[?:?] 34 at java.util.Collections$UnmodifiableList.get(Collections.java:1308) ~[?:?] 35 at java.util.Collections$UnmodifiableList.get(Collections.java:1308) ~[?:?] 36 at java.util.Collections$UnmodifiableList.get(Collections.java:1308) ~[?:?] 37 at java.util.Collections$UnmodifiableList.get(Collections.java:1308) ~[?:?] 38 at java.util.Collections$UnmodifiableList.get(Collections.java:1308) ~[?:?] 39 at java.util.Collections$UnmodifiableList.get(Collections.java:1308) ~[?:?]

command: REFRESH EXTERNAL TABLE hive.mysql_prod_enlightent_daily.movie_total_heat

Real behavior (Required)

Exception: [1064][42000]

github-actions[bot] commented 1 month ago

We have marked this issue as stale because it has been inactive for 6 months. If this issue is still relevant, removing the stale label or adding a comment will keep it active. Otherwise, we'll close it in 10 days to keep the issue queue tidy. Thank you for your contribution to StarRocks!