search

apache / incubator-hugegraph-tools

HugeGraph Database deploy and manage tool
Apache License 2.0
21 stars 29 forks source link

graph-clear清除数据报错(backend=hbase) #62

Closed tmljob closed 3 years ago

tmljob commented 4 years ago

backend=hbase时，运行graph-clear清除数据报错，无法正常清除数据。 具体错误信息如下所示： [root@cluster-node-2 hugegraph-tools-1.4.0]# bin/hugegraph graph-clear -c "I'm sure to delete all data" Exception in thread "main" class com.baidu.hugegraph.backend.BackendException: Failed to truncate table 's_li' for 's' at com.baidu.hugegraph.exception.ServerException.fromResponse(ServerException.java:44) at com.baidu.hugegraph.client.RestClient.checkStatus(RestClient.java:100) at com.baidu.hugegraph.rest.RestClient.delete(RestClient.java:232) at com.baidu.hugegraph.api.graphs.GraphsAPI.clear(GraphsAPI.java:82) at com.baidu.hugegraph.driver.GraphsManager.clear(GraphsManager.java:54) at com.baidu.hugegraph.manager.GraphsManager.clear(GraphsManager.java:44) at com.baidu.hugegraph.cmd.HugeGraphCommand.execute(HugeGraphCommand.java:222) at com.baidu.hugegraph.cmd.HugeGraphCommand.main(HugeGraphCommand.java:379) Caused by: java.io.InterruptedIOException: Interrupt while waiting on Operation: DISABLE, Table Name: tinkerpop:s_li

说明： 1、已配置url&graph&timeout等相关参数，如下 export HUGEGRAPH_URL=http://10.19.151.142:8080 export HUGEGRAPH_GRAPH=tinkerpop

export HUGEGRAPH_USERNAME=

export HUGEGRAPH_PASSWORD=

export HUGEGRAPH_TIMEOUT=360000

2、换成backend=mysql的，运行清除命令可以正常清除。

javeme commented 4 years ago

@tmljob hbase的clear确实存在较严重的超时问题（truncate table耗时过长），可以尝试重试或者手动清空，或者调大超时时间task.wait_timeout

tmljob commented 4 years ago

在{graph-name}.properties中配置了task.wait_timeout=720，但似乎没有用，也没有等到这个超时时间就报错了。 [root@cluster-node-2 hugegraph-tools-1.4.0]# bin/hugegraph graph-clear -c "I'm sure to delete all data" exec /usr/java/jdk1.8.0_181-cloudera/bin/java -Xms512m -Xmx26583m -cp /opt/hugegraph/hugegraph-tools-1.4.0/lib/hugegraph-tools-*.jar -Djava.ext.dirs=/opt/hugegraph/hugegraph-tools-1.4.0/lib/ com.baidu.hugegraph.cmd.HugeGraphCommand --url http://10.19.151.142:8080 --graph tinkerpop --timeout 360000 graph-clear -c I'm sure to delete all data Exception in thread "main" class com.baidu.hugegraph.backend.BackendException: Failed to truncate table 'g_ie' for 'g' at com.baidu.hugegraph.exception.ServerException.fromResponse(ServerException.java:44) at com.baidu.hugegraph.client.RestClient.checkStatus(RestClient.java:100) at com.baidu.hugegraph.rest.RestClient.delete(RestClient.java:232) at com.baidu.hugegraph.api.graphs.GraphsAPI.clear(GraphsAPI.java:82) at com.baidu.hugegraph.driver.GraphsManager.clear(GraphsManager.java:54) at com.baidu.hugegraph.manager.GraphsManager.clear(GraphsManager.java:44) at com.baidu.hugegraph.cmd.HugeGraphCommand.execute(HugeGraphCommand.java:222) at com.baidu.hugegraph.cmd.HugeGraphCommand.main(HugeGraphCommand.java:379) Caused by: java.io.InterruptedIOException: Interrupt while waiting on Operation: DISABLE, Table Name: tinkerpop:g_ie

其中，tinkerpop.properties 配置了

vertex.default_label=vertex

task.wait_timeout=720 然后重启了hugeGraphServer，但有用，也没有等到这个超时时间就报错了。

javeme commented 4 years ago

@tmljob hbase中的数据量有多少？

tmljob commented 4 years ago

没有多少数据量，按照这个链接(https://www.jianshu.com/p/618cf6667381)的说明，建了个“TinkerPop关系图”，做下学习验证后，然后想清掉，就发现graph-clear运行报错。 另外，我后面手动把hbase里面建的表drop了，然后重启初始化，这个时候是没数据的，graph-clear运行还是报这种错误。

tmljob commented 4 years ago

这个与我们部署了多个hugegraph-server，backend 对接的是同一套hbase集群有没有关系？ @javeme

tmljob commented 4 years ago

我把其他hugegraph-server停了，task.wait_timeout参数也调整了，graph-clear运行还是报这种错误。 @javeme [root@cluster-node-2 hugegraph-tools-1.4.0]# bin/hugegraph graph-clear -c "I'm sure to delete all data" exec /usr/java/jdk1.8.0_181-cloudera/bin/java -Xms512m -Xmx25382m -cp /opt/hugegraph/hugegraph-tools-1.4.0/lib/hugegraph-tools-*.jar -Djava.ext.dirs=/opt/hugegraph/hugegraph-tools-1.4.0/lib/ com.baidu.hugegraph.cmd.HugeGraphCommand --url http://10.19.151.142:8080 --graph tinkerpop --timeout 360000 graph-clear -c I'm sure to delete all data Exception in thread "main" class com.baidu.hugegraph.backend.BackendException: Failed to truncate table 's_ei' for 's' at com.baidu.hugegraph.exception.ServerException.fromResponse(ServerException.java:44) at com.baidu.hugegraph.client.RestClient.checkStatus(RestClient.java:100) at com.baidu.hugegraph.rest.RestClient.delete(RestClient.java:232) at com.baidu.hugegraph.api.graphs.GraphsAPI.clear(GraphsAPI.java:82) at com.baidu.hugegraph.driver.GraphsManager.clear(GraphsManager.java:54) at com.baidu.hugegraph.manager.GraphsManager.clear(GraphsManager.java:44) at com.baidu.hugegraph.cmd.HugeGraphCommand.execute(HugeGraphCommand.java:222) at com.baidu.hugegraph.cmd.HugeGraphCommand.main(HugeGraphCommand.java:379) Caused by: java.io.InterruptedIOException: Interrupt while waiting on Operation: DISABLE, Table Name: tinkerpop:s_ei

tmljob commented 4 years ago

@javeme ，这个graph-clear清除hbase数据无法运行，就是最新初始化完成的hbase也会报这种错误。 备注： 1、task.wait_timeout参数调整了，并重启了服务后再验证； 2、多次重试也是一样的；

imbajin commented 3 years ago

@javeme ，这个graph-clear清除hbase数据无法运行，就是最新初始化完成的hbase也会报这种错误。 备注： 1、task.wait_timeout参数调整了，并重启了服务后再验证； 2、多次重试也是一样的；

新版图的确是有这个清除很慢很容易失败问题, 有空得认真看看+测试下, 看看怎么处理比较好 (完全同步? 完全异步? 整体同步+中间异步? 耗时慢的原因之类的)

目前的话, 除了写个脚本去Hbase里通过shell批量清除的方式. 比较建议的方式还是先用rocksdb作为后端测试, hbase目前先不做测试后端使用吧

tmljob commented 3 years ago

server0.11.2+tool1.5.0版本还是存在这个问题。 1、task.wait_timeout已设置为300，并未达到超时时间； 2、多次重试还是异常中断； 具体信息如下： 执行 ./bin/hugegraph graph-clear -c "I'm sure to delete all data" 控制台信息：

./bin/hugegraph graph-clear -c "I'm sure to delete all data"
Exception in thread "main" class com.baidu.hugegraph.backend.BackendException: Failed to truncate table for 'g' store
        at com.baidu.hugegraph.exception.ServerException.fromResponse(ServerException.java:47)
        at com.baidu.hugegraph.client.RestClient.checkStatus(RestClient.java:93)
        at com.baidu.hugegraph.rest.AbstractRestClient.delete(AbstractRestClient.java:282)
        at com.baidu.hugegraph.api.graphs.GraphsAPI.clear(GraphsAPI.java:82)
        at com.baidu.hugegraph.driver.GraphsManager.clear(GraphsManager.java:54)
        at com.baidu.hugegraph.manager.GraphsManager.clear(GraphsManager.java:44)
        at com.baidu.hugegraph.cmd.HugeGraphCommand.execute(HugeGraphCommand.java:261)
        at com.baidu.hugegraph.cmd.HugeGraphCommand.main(HugeGraphCommand.java:427)
Caused by: com.baidu.hugegraph.backend.BackendException: Error when truncating table 'g_ie' of 'g' store: java.lang.InterruptedException: Interrupted while waiting for the result of proc 1122

hugegraph-server日志信息：

2020-12-15 10:33:18 392137 [grizzly-http-server-9] [INFO ] org.apache.hadoop.hbase.client.HBaseAdmin [] - Started disable of daas:s_hi
2020-12-15 10:33:19 392433 [grizzly-http-server-9] [INFO ] org.apache.hadoop.hbase.client.HBaseAdmin [] - Started disable of daas:s_oe
2020-12-15 10:33:19 392715 [grizzly-http-server-9] [INFO ] org.apache.hadoop.hbase.client.HBaseAdmin [] - Started disable of daas:s_ii
2020-12-15 10:33:19 393156 [grizzly-http-server-9] [INFO ] org.apache.hadoop.hbase.client.HBaseAdmin [] - Started disable of daas:s_li
2020-12-15 10:33:20 393571 [grizzly-http-server-9] [INFO ] org.apache.hadoop.hbase.client.HBaseAdmin [] - Started disable of daas:s_ei
2020-12-15 10:33:20 393761 [grizzly-http-server-9] [INFO ] org.apache.hadoop.hbase.client.HBaseAdmin [] - Started disable of daas:s_ie
2020-12-15 10:33:21 394583 [grizzly-http-server-9] [INFO ] org.apache.hadoop.hbase.client.HBaseAdmin [] - Started disable of daas:s_si
2020-12-15 10:33:21 394857 [grizzly-http-server-9] [INFO ] org.apache.hadoop.hbase.client.HBaseAdmin [] - Started disable of daas:s_v
2020-12-15 10:33:21 395089 [grizzly-http-server-9] [INFO ] org.apache.hadoop.hbase.client.HBaseAdmin [] - Started disable of daas:s_fi
2020-12-15 10:33:22 395533 [grizzly-http-server-9] [INFO ] org.apache.hadoop.hbase.client.HBaseAdmin [] - Started disable of daas:s_ai
2020-12-15 10:33:22 395858 [grizzly-http-server-9] [INFO ] org.apache.hadoop.hbase.client.HBaseAdmin [] - Started disable of daas:s_di
2020-12-15 10:33:22 396111 [grizzly-http-server-9] [INFO ] org.apache.hadoop.hbase.client.HBaseAdmin [] - Started disable of daas:s_ui
2020-12-15 10:33:22 396336 [grizzly-http-server-9] [INFO ] org.apache.hadoop.hbase.client.HBaseAdmin [] - Started disable of daas:s_vi
2020-12-15 10:33:25 398845 [grizzly-http-server-9] [INFO ] org.apache.hadoop.hbase.client.HBaseAdmin [] - Operation: DISABLE, Table Name: daas:s_ai, procId: 1056 completed
2020-12-15 10:33:25 398847 [grizzly-http-server-9] [INFO ] org.apache.hadoop.hbase.client.HBaseAdmin [] - Operation: DISABLE, Table Name: daas:s_di, procId: 1057 completed
2020-12-15 10:33:25 398848 [grizzly-http-server-9] [INFO ] org.apache.hadoop.hbase.client.HBaseAdmin [] - Operation: DISABLE, Table Name: daas:s_ei, procId: 1046 completed
2020-12-15 10:33:26 399456 [grizzly-http-server-9] [INFO ] org.apache.hadoop.hbase.client.HBaseAdmin [] - Operation: DISABLE, Table Name: daas:s_vi, procId: 1061 completed
2020-12-15 10:33:26 399458 [grizzly-http-server-9] [INFO ] org.apache.hadoop.hbase.client.HBaseAdmin [] - Operation: DISABLE, Table Name: daas:s_v, procId: 1052 completed
2020-12-15 10:33:26 399459 [grizzly-http-server-9] [INFO ] org.apache.hadoop.hbase.client.HBaseAdmin [] - Operation: DISABLE, Table Name: daas:s_ui, procId: 1059 completed
2020-12-15 10:33:26 399461 [grizzly-http-server-9] [INFO ] org.apache.hadoop.hbase.client.HBaseAdmin [] - Operation: DISABLE, Table Name: daas:s_oe, procId: 1040 completed
2020-12-15 10:33:26 399462 [grizzly-http-server-9] [INFO ] org.apache.hadoop.hbase.client.HBaseAdmin [] - Operation: DISABLE, Table Name: daas:s_si, procId: 1050 completed
2020-12-15 10:33:26 399463 [grizzly-http-server-9] [INFO ] org.apache.hadoop.hbase.client.HBaseAdmin [] - Operation: DISABLE, Table Name: daas:s_hi, procId: 1039 completed
2020-12-15 10:33:26 399464 [grizzly-http-server-9] [INFO ] org.apache.hadoop.hbase.client.HBaseAdmin [] - Operation: DISABLE, Table Name: daas:s_ii, procId: 1042 completed
2020-12-15 10:33:26 399465 [grizzly-http-server-9] [INFO ] org.apache.hadoop.hbase.client.HBaseAdmin [] - Operation: DISABLE, Table Name: daas:s_fi, procId: 1053 completed
2020-12-15 10:33:26 399466 [grizzly-http-server-9] [INFO ] org.apache.hadoop.hbase.client.HBaseAdmin [] - Operation: DISABLE, Table Name: daas:s_li, procId: 1044 completed
2020-12-15 10:33:26 399468 [grizzly-http-server-9] [INFO ] org.apache.hadoop.hbase.client.HBaseAdmin [] - Operation: DISABLE, Table Name: daas:s_ie, procId: 1048 completed
2020-12-15 10:33:26 399468 [grizzly-http-server-9] [INFO ] org.apache.hadoop.hbase.client.HBaseAdmin [] - Started truncating daas:s_hi
2020-12-15 10:33:26 399687 [grizzly-http-server-9] [INFO ] org.apache.hadoop.hbase.client.HBaseAdmin [] - Started truncating daas:s_oe
2020-12-15 10:33:26 399828 [grizzly-http-server-9] [INFO ] org.apache.hadoop.hbase.client.HBaseAdmin [] - Started truncating daas:s_ii
2020-12-15 10:33:26 400111 [grizzly-http-server-9] [INFO ] org.apache.hadoop.hbase.client.HBaseAdmin [] - Started truncating daas:s_li
2020-12-15 10:33:26 400316 [grizzly-http-server-9] [INFO ] org.apache.hadoop.hbase.client.HBaseAdmin [] - Started truncating daas:s_ei
2020-12-15 10:33:27 400491 [grizzly-http-server-9] [INFO ] org.apache.hadoop.hbase.client.HBaseAdmin [] - Started truncating daas:s_ie
2020-12-15 10:33:27 400680 [grizzly-http-server-9] [INFO ] org.apache.hadoop.hbase.client.HBaseAdmin [] - Started truncating daas:s_si
2020-12-15 10:33:27 400804 [grizzly-http-server-9] [INFO ] org.apache.hadoop.hbase.client.HBaseAdmin [] - Started truncating daas:s_v
2020-12-15 10:33:27 401034 [grizzly-http-server-9] [INFO ] org.apache.hadoop.hbase.client.HBaseAdmin [] - Started truncating daas:s_fi
2020-12-15 10:33:27 401233 [grizzly-http-server-9] [INFO ] org.apache.hadoop.hbase.client.HBaseAdmin [] - Started truncating daas:s_ai
2020-12-15 10:33:28 401418 [grizzly-http-server-9] [INFO ] org.apache.hadoop.hbase.client.HBaseAdmin [] - Started truncating daas:s_di
2020-12-15 10:33:28 401622 [grizzly-http-server-9] [INFO ] org.apache.hadoop.hbase.client.HBaseAdmin [] - Started truncating daas:s_ui
2020-12-15 10:33:28 402181 [grizzly-http-server-9] [INFO ] org.apache.hadoop.hbase.client.HBaseAdmin [] - Started truncating daas:s_vi
2020-12-15 10:33:37 410479 [grizzly-http-server-9] [INFO ] org.apache.hadoop.hbase.client.HBaseAdmin [] - Operation: TRUNCATE, Table Name: daas:s_ai, procId: 1074 completed
2020-12-15 10:33:37 410481 [grizzly-http-server-9] [INFO ] org.apache.hadoop.hbase.client.HBaseAdmin [] - Operation: TRUNCATE, Table Name: daas:s_di, procId: 1075 completed
2020-12-15 10:33:37 410483 [grizzly-http-server-9] [INFO ] org.apache.hadoop.hbase.client.HBaseAdmin [] - Operation: TRUNCATE, Table Name: daas:s_ei, procId: 1069 completed
2020-12-15 10:33:37 410484 [grizzly-http-server-9] [INFO ] org.apache.hadoop.hbase.client.HBaseAdmin [] - Operation: TRUNCATE, Table Name: daas:s_vi, procId: 1077 completed
2020-12-15 10:33:37 410485 [grizzly-http-server-9] [INFO ] org.apache.hadoop.hbase.client.HBaseAdmin [] - Operation: TRUNCATE, Table Name: daas:s_v, procId: 1072 completed
2020-12-15 10:33:37 410486 [grizzly-http-server-9] [INFO ] org.apache.hadoop.hbase.client.HBaseAdmin [] - Operation: TRUNCATE, Table Name: daas:s_ui, procId: 1076 completed
2020-12-15 10:33:37 410488 [grizzly-http-server-9] [INFO ] org.apache.hadoop.hbase.client.HBaseAdmin [] - Operation: TRUNCATE, Table Name: daas:s_oe, procId: 1066 completed
2020-12-15 10:33:37 410490 [grizzly-http-server-9] [INFO ] org.apache.hadoop.hbase.client.HBaseAdmin [] - Operation: TRUNCATE, Table Name: daas:s_si, procId: 1071 completed
2020-12-15 10:33:37 410492 [grizzly-http-server-9] [INFO ] org.apache.hadoop.hbase.client.HBaseAdmin [] - Operation: TRUNCATE, Table Name: daas:s_hi, procId: 1065 completed
2020-12-15 10:33:37 410493 [grizzly-http-server-9] [INFO ] org.apache.hadoop.hbase.client.HBaseAdmin [] - Operation: TRUNCATE, Table Name: daas:s_ii, procId: 1067 completed
2020-12-15 10:33:37 410495 [grizzly-http-server-9] [INFO ] org.apache.hadoop.hbase.client.HBaseAdmin [] - Operation: TRUNCATE, Table Name: daas:s_fi, procId: 1073 completed
2020-12-15 10:33:37 410496 [grizzly-http-server-9] [INFO ] org.apache.hadoop.hbase.client.HBaseAdmin [] - Operation: TRUNCATE, Table Name: daas:s_li, procId: 1068 completed
2020-12-15 10:33:37 410498 [grizzly-http-server-9] [INFO ] org.apache.hadoop.hbase.client.HBaseAdmin [] - Operation: TRUNCATE, Table Name: daas:s_ie, procId: 1070 completed
2020-12-15 10:33:37 410500 [grizzly-http-server-9] [INFO ] org.apache.hadoop.hbase.client.HBaseAdmin [] - Started disable of daas:g_hi
2020-12-15 10:33:37 410812 [grizzly-http-server-9] [INFO ] org.apache.hadoop.hbase.client.HBaseAdmin [] - Started disable of daas:g_oe
2020-12-15 10:33:37 411206 [grizzly-http-server-9] [INFO ] org.apache.hadoop.hbase.client.HBaseAdmin [] - Started disable of daas:g_ii
2020-12-15 10:33:38 411523 [grizzly-http-server-9] [INFO ] org.apache.hadoop.hbase.client.HBaseAdmin [] - Started disable of daas:g_li
2020-12-15 10:33:38 412333 [grizzly-http-server-9] [INFO ] org.apache.hadoop.hbase.client.HBaseAdmin [] - Started disable of daas:g_ei
2020-12-15 10:33:39 412794 [grizzly-http-server-9] [INFO ] org.apache.hadoop.hbase.client.HBaseAdmin [] - Started disable of daas:g_ie
2020-12-15 10:33:39 413195 [grizzly-http-server-9] [INFO ] org.apache.hadoop.hbase.client.HBaseAdmin [] - Started disable of daas:g_si
2020-12-15 10:33:40 413664 [grizzly-http-server-9] [INFO ] org.apache.hadoop.hbase.client.HBaseAdmin [] - Started disable of daas:g_v
2020-12-15 10:33:40 413966 [grizzly-http-server-9] [INFO ] org.apache.hadoop.hbase.client.HBaseAdmin [] - Started disable of daas:g_fi
2020-12-15 10:33:40 414209 [grizzly-http-server-9] [INFO ] org.apache.hadoop.hbase.client.HBaseAdmin [] - Started disable of daas:g_ai
2020-12-15 10:33:41 414428 [grizzly-http-server-9] [INFO ] org.apache.hadoop.hbase.client.HBaseAdmin [] - Started disable of daas:g_di
2020-12-15 10:33:41 414860 [grizzly-http-server-9] [INFO ] org.apache.hadoop.hbase.client.HBaseAdmin [] - Started disable of daas:g_ui
2020-12-15 10:33:41 415092 [grizzly-http-server-9] [INFO ] org.apache.hadoop.hbase.client.HBaseAdmin [] - Started disable of daas:g_vi
2020-12-15 10:33:42 415468 [grizzly-http-server-9] [INFO ] org.apache.hadoop.hbase.client.HBaseAdmin [] - Operation: DISABLE, Table Name: daas:g_ie, procId: 1100 completed
2020-12-15 10:33:42 415469 [grizzly-http-server-9] [INFO ] org.apache.hadoop.hbase.client.HBaseAdmin [] - Operation: DISABLE, Table Name: daas:g_li, procId: 1095 completed
2020-12-15 10:33:42 415470 [grizzly-http-server-9] [INFO ] org.apache.hadoop.hbase.client.HBaseAdmin [] - Operation: DISABLE, Table Name: daas:g_ii, procId: 1094 completed
2020-12-15 10:33:42 415471 [grizzly-http-server-9] [INFO ] org.apache.hadoop.hbase.client.HBaseAdmin [] - Operation: DISABLE, Table Name: daas:g_hi, procId: 1091 completed
2020-12-15 10:33:43 416580 [grizzly-http-server-9] [INFO ] org.apache.hadoop.hbase.client.HBaseAdmin [] - Operation: DISABLE, Table Name: daas:g_fi, procId: 1105 completed
2020-12-15 10:33:43 416582 [grizzly-http-server-9] [INFO ] org.apache.hadoop.hbase.client.HBaseAdmin [] - Operation: DISABLE, Table Name: daas:g_ei, procId: 1097 completed
2020-12-15 10:33:44 417691 [grizzly-http-server-9] [INFO ] org.apache.hadoop.hbase.client.HBaseAdmin [] - Operation: DISABLE, Table Name: daas:g_di, procId: 1109 completed
2020-12-15 10:33:44 417693 [grizzly-http-server-9] [INFO ] org.apache.hadoop.hbase.client.HBaseAdmin [] - Operation: DISABLE, Table Name: daas:g_ai, procId: 1107 completed
2020-12-15 10:33:44 418300 [grizzly-http-server-9] [INFO ] org.apache.hadoop.hbase.client.HBaseAdmin [] - Operation: DISABLE, Table Name: daas:g_vi, procId: 1114 completed
2020-12-15 10:33:44 418302 [grizzly-http-server-9] [INFO ] org.apache.hadoop.hbase.client.HBaseAdmin [] - Operation: DISABLE, Table Name: daas:g_ui, procId: 1112 completed
2020-12-15 10:33:44 418307 [grizzly-http-server-9] [INFO ] org.apache.hadoop.hbase.client.HBaseAdmin [] - Operation: DISABLE, Table Name: daas:g_oe, procId: 1092 completed
2020-12-15 10:33:44 418309 [grizzly-http-server-9] [INFO ] org.apache.hadoop.hbase.client.HBaseAdmin [] - Operation: DISABLE, Table Name: daas:g_si, procId: 1102 completed
2020-12-15 10:33:44 418311 [grizzly-http-server-9] [INFO ] org.apache.hadoop.hbase.client.HBaseAdmin [] - Operation: DISABLE, Table Name: daas:g_v, procId: 1104 completed
2020-12-15 10:33:44 418312 [grizzly-http-server-9] [INFO ] org.apache.hadoop.hbase.client.HBaseAdmin [] - Started truncating daas:g_hi
2020-12-15 10:33:45 418491 [grizzly-http-server-9] [INFO ] org.apache.hadoop.hbase.client.HBaseAdmin [] - Started truncating daas:g_oe
2020-12-15 10:33:45 418852 [grizzly-http-server-9] [INFO ] org.apache.hadoop.hbase.client.HBaseAdmin [] - Started truncating daas:g_ii
2020-12-15 10:33:45 419114 [grizzly-http-server-9] [INFO ] org.apache.hadoop.hbase.client.HBaseAdmin [] - Started truncating daas:g_li
2020-12-15 10:33:45 419290 [grizzly-http-server-9] [INFO ] org.apache.hadoop.hbase.client.HBaseAdmin [] - Started truncating daas:g_ei
2020-12-15 10:33:46 419449 [grizzly-http-server-9] [INFO ] org.apache.hadoop.hbase.client.HBaseAdmin [] - Started truncating daas:g_ie
2020-12-15 10:33:46 419607 [grizzly-http-server-9] [INFO ] org.apache.hadoop.hbase.client.HBaseAdmin [] - Started truncating daas:g_si
2020-12-15 10:33:46 419682 [grizzly-http-server-9] [INFO ] org.apache.hadoop.hbase.client.HBaseAdmin [] - Started truncating daas:g_v
2020-12-15 10:33:46 419867 [grizzly-http-server-9] [INFO ] org.apache.hadoop.hbase.client.HBaseAdmin [] - Started truncating daas:g_fi
2020-12-15 10:33:46 420032 [grizzly-http-server-9] [INFO ] org.apache.hadoop.hbase.client.HBaseAdmin [] - Started truncating daas:g_ai
2020-12-15 10:33:46 420282 [grizzly-http-server-9] [INFO ] org.apache.hadoop.hbase.client.HBaseAdmin [] - Started truncating daas:g_di
2020-12-15 10:33:47 420474 [grizzly-http-server-9] [INFO ] org.apache.hadoop.hbase.client.HBaseAdmin [] - Started truncating daas:g_ui
2020-12-15 10:33:47 420710 [grizzly-http-server-9] [INFO ] org.apache.hadoop.hbase.client.HBaseAdmin [] - Started truncating daas:g_vi
2020-12-15 10:33:49 422583 [grizzly-http-server-9] [INFO ] org.apache.hadoop.hbase.client.HBaseAdmin [] - Started enable of daas:g_hi
2020-12-15 10:33:53 427006 [grizzly-http-server-9] [INFO ] org.apache.hadoop.hbase.client.HBaseAdmin [] - Operation: ENABLE, Table Name: daas:g_hi, procId: 1131 failed with tableName=daas:g_hi, state=ENABLING
2020-12-15 10:33:53 427026 [grizzly-http-server-9] [INFO ] org.apache.hadoop.hbase.client.HBaseAdmin [] - Started enable of daas:g_vi
2020-12-15 10:33:54 428305 [grizzly-http-server-9] [INFO ] org.apache.hadoop.hbase.client.HBaseAdmin [] - Operation: ENABLE, Table Name: daas:g_vi, procId: 1144 failed with tableName=daas:g_vi, state=ENABLED
2020-12-15 10:37:48 661719 [ReadOnlyZKClient-cluster-node-4:2181,cluster-node-3:2181,cluster-node-2:2181@0x36359723] [WARN ] org.apache.hadoop.hbase.client.ZKAsyncRegistry [] - Meta region is in state OPENING

控制台异常后就卡在这了，server日志也不再有打印，只能中断退出。

@javeme @imbajin

javeme commented 3 years ago

@tmljob 可以定位一下在哪一步hbase调用的时候超时吗？ Interrupted while waiting for the result of proc 1122 看一下1122对应的是什么操作？

tmljob commented 3 years ago

这个每次运行clear都不一样，并且我在多次反复执行clear命令后，server的日志报“TableNotFoundException”，但实际上是表是存在的。

2020-12-25 11:20:29 262069481 [grizzly-http-server-37] [INFO ] org.apache.hadoop.hbase.client.HBaseAdmin [] - Started truncating daas:g_fi
2020-12-25 11:20:29 262069649 [grizzly-http-server-37] [INFO ] org.apache.hadoop.hbase.client.HBaseAdmin [] - Started truncating daas:g_ai
2020-12-25 11:20:30 262069837 [grizzly-http-server-37] [INFO ] org.apache.hadoop.hbase.client.HBaseAdmin [] - Started truncating daas:g_di
2020-12-25 11:20:31 262071092 [grizzly-http-server-37] [INFO ] org.apache.hadoop.hbase.client.HBaseAdmin [] - Started truncating daas:g_ui
2020-12-25 11:20:31 262071233 [grizzly-http-server-37] [WARN ] com.baidu.hugegraph.backend.store.hbase.HbaseStore [] - Failed to enable table 'g_hi' of 'g' store
org.apache.hadoop.hbase.TableNotFoundException: daas:g_hi
        at org.apache.hadoop.hbase.client.HBaseAdmin$42.rpcCall(HBaseAdmin.java:2048) ~[hbase-client-2.0.6.jar:2.0.6]
        at org.apache.hadoop.hbase.client.HBaseAdmin$42.rpcCall(HBaseAdmin.java:2044) ~[hbase-client-2.0.6.jar:2.0.6]
        at org.apache.hadoop.hbase.client.RpcRetryingCallable.call(RpcRetryingCallable.java:58) ~[hbase-client-2.0.6.jar:2.0.6]
        at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:107) ~[hbase-client-2.0.6.jar:2.0.6]
        at org.apache.hadoop.hbase.client.HBaseAdmin.executeCallable(HBaseAdmin.java:3084) ~[hbase-client-2.0.6.jar:2.0.6]
        at org.apache.hadoop.hbase.client.HBaseAdmin.executeCallable(HBaseAdmin.java:3076) ~[hbase-client-2.0.6.jar:2.0.6]
        at org.apache.hadoop.hbase.client.HBaseAdmin.checkTableExists(HBaseAdmin.java:2044) ~[hbase-client-2.0.6.jar:2.0.6]
        at org.apache.hadoop.hbase.client.HBaseAdmin.isTableEnabled(HBaseAdmin.java:971) ~[hbase-client-2.0.6.jar:2.0.6]
        at com.baidu.hugegraph.backend.store.hbase.HbaseSessions.enableTable(HbaseSessions.java:246) ~[hugegraph-hbase-0.11.2.jar:?]
        at com.baidu.hugegraph.backend.store.hbase.HbaseStore.enableTables(HbaseStore.java:395) [hugegraph-hbase-0.11.2.jar:?]
        at com.baidu.hugegraph.backend.store.hbase.HbaseStore.truncate(HbaseStore.java:384) [hugegraph-hbase-0.11.2.jar:?]
        at com.baidu.hugegraph.backend.store.AbstractBackendStoreProvider.truncate(AbstractBackendStoreProvider.java:136) [hugegraph-core-0.11.2.jar:0.11.2.0]
        at com.baidu.hugegraph.StandardHugeGraph.truncateBackend(StandardHugeGraph.java:306) [hugegraph-core-0.11.2.jar:0.11.2.0]
        at com.baidu.hugegraph.api.profile.GraphsAPI.clear(GraphsAPI.java:137) [hugegraph-api-0.11.2.jar:0.58.0.0]
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_181]
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_181]
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_181]
        at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_181]
        at org.glassfish.jersey.server.model.internal.ResourceMethodInvocationHandlerFactory$1.invoke(ResourceMethodInvocationHandlerFactory.java:81) [jersey-server-2.25.1.jar:?]
        at org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher$1.run(AbstractJavaResourceMethodDispatcher.java:144) [jersey-server-2.25.1.jar:?]
        at org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher.invoke(AbstractJavaResourceMethodDispatcher.java:161) [jersey-server-2.25.1.jar:?]
        at org.glassfish.jersey.server.model.internal.JavaResourceMethodDispatcherProvider$VoidOutInvoker.doDispatch(JavaResourceMethodDispatcherProvider.java:143) [jersey-server-2.25.1.jar:?]
        at org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher.dispatch(AbstractJavaResourceMethodDispatcher.java:99) [jersey-server-2.25.1.jar:?]
        at org.glassfish.jersey.server.model.ResourceMethodInvoker.invoke(ResourceMethodInvoker.java:389) [jersey-server-2.25.1.jar:?]
        at org.glassfish.jersey.server.model.ResourceMethodInvoker.apply(ResourceMethodInvoker.java:347) [jersey-server-2.25.1.jar:?]
        at org.glassfish.jersey.server.model.ResourceMethodInvoker.apply(ResourceMethodInvoker.java:102) [jersey-server-2.25.1.jar:?]
        at org.glassfish.jersey.server.ServerRuntime$2.run(ServerRuntime.java:326) [jersey-server-2.25.1.jar:?]
        at org.glassfish.jersey.internal.Errors$1.call(Errors.java:271) [jersey-common-2.25.1.jar:?]
        at org.glassfish.jersey.internal.Errors$1.call(Errors.java:267) [jersey-common-2.25.1.jar:?]
        at org.glassfish.jersey.internal.Errors.process(Errors.java:315) [jersey-common-2.25.1.jar:?]
        at org.glassfish.jersey.internal.Errors.process(Errors.java:297) [jersey-common-2.25.1.jar:?]
        at org.glassfish.jersey.internal.Errors.process(Errors.java:267) [jersey-common-2.25.1.jar:?]
        at org.glassfish.jersey.process.internal.RequestScope.runInScope(RequestScope.java:317) [jersey-common-2.25.1.jar:?]
        at org.glassfish.jersey.server.ServerRuntime.process(ServerRuntime.java:305) [jersey-server-2.25.1.jar:?]
        at org.glassfish.jersey.server.ApplicationHandler.handle(ApplicationHandler.java:1154) [jersey-server-2.25.1.jar:?]
        at org.glassfish.jersey.grizzly2.httpserver.GrizzlyHttpContainer.service(GrizzlyHttpContainer.java:384) [jersey-container-grizzly2-http-2.25.1.jar:?]
        at org.glassfish.grizzly.http.server.HttpHandler$1.run(HttpHandler.java:200) [grizzly-http-server-2.4.4.jar:2.4.4]
        at org.glassfish.grizzly.threadpool.AbstractThreadPool$Worker.doWork(AbstractThreadPool.java:569) [grizzly-framework-2.4.4.jar:2.4.4]
        at org.glassfish.grizzly.threadpool.AbstractThreadPool$Worker.run(AbstractThreadPool.java:549) [grizzly-framework-2.4.4.jar:2.4.4]
        at java.lang.Thread.run(Thread.java:748) [?:1.8.0_181]
2020-12-25 11:20:31 262071235 [grizzly-http-server-37] [WARN ] com.baidu.hugegraph.backend.store.hbase.HbaseStore [] - Failed to enable table 'g_oe' of 'g' store
org.apache.hadoop.hbase.TableNotFoundException: daas:g_oe
        at org.apache.hadoop.hbase.client.HBaseAdmin$42.rpcCall(HBaseAdmin.java:2048) ~[hbase-client-2.0.6.jar:2.0.6]
        at org.apache.hadoop.hbase.client.HBaseAdmin$42.rpcCall(HBaseAdmin.java:2044) ~[hbase-client-2.0.6.jar:2.0.6]
        at org.apache.hadoop.hbase.client.RpcRetryingCallable.call(RpcRetryingCallable.java:58) ~[hbase-client-2.0.6.jar:2.0.6]
        at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:107) ~[hbase-client-2.0.6.jar:2.0.6]
        at org.apache.hadoop.hbase.client.HBaseAdmin.executeCallable(HBaseAdmin.java:3084) ~[hbase-client-2.0.6.jar:2.0.6]
        at org.apache.hadoop.hbase.client.HBaseAdmin.executeCallable(HBaseAdmin.java:3076) ~[hbase-client-2.0.6.jar:2.0.6]
        at org.apache.hadoop.hbase.client.HBaseAdmin.checkTableExists(HBaseAdmin.java:2044) ~[hbase-client-2.0.6.jar:2.0.6]
        at org.apache.hadoop.hbase.client.HBaseAdmin.isTableEnabled(HBaseAdmin.java:971) ~[hbase-client-2.0.6.jar:2.0.6]
        at com.baidu.hugegraph.backend.store.hbase.HbaseSessions.enableTable(HbaseSessions.java:246) ~[hugegraph-hbase-0.11.2.jar:?]
        at com.baidu.hugegraph.backend.store.hbase.HbaseStore.enableTables(HbaseStore.java:395) [hugegraph-hbase-0.11.2.jar:?]
        at com.baidu.hugegraph.backend.store.hbase.HbaseStore.truncate(HbaseStore.java:384) [hugegraph-hbase-0.11.2.jar:?]
        at com.baidu.hugegraph.backend.store.AbstractBackendStoreProvider.truncate(AbstractBackendStoreProvider.java:136) [hugegraph-core-0.11.2.jar:0.11.2.0]
        at com.baidu.hugegraph.StandardHugeGraph.truncateBackend(StandardHugeGraph.java:306) [hugegraph-core-0.11.2.jar:0.11.2.0]
        at com.baidu.hugegraph.api.profile.GraphsAPI.clear(GraphsAPI.java:137) [hugegraph-api-0.11.2.jar:0.58.0.0]
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_181]
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_181]
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_181]
        at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_181]
        at org.glassfish.jersey.server.model.internal.ResourceMethodInvocationHandlerFactory$1.invoke(ResourceMethodInvocationHandlerFactory.java:81) [jersey-server-2.25.1.jar:?]
        at org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher$1.run(AbstractJavaResourceMethodDispatcher.java:144) [jersey-server-2.25.1.jar:?]
        at org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher.invoke(AbstractJavaResourceMethodDispatcher.java:161) [jersey-server-2.25.1.jar:?]
        at org.glassfish.jersey.server.model.internal.JavaResourceMethodDispatcherProvider$VoidOutInvoker.doDispatch(JavaResourceMethodDispatcherProvider.java:143) [jersey-server-2.25.1.jar:?]
        at org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher.dispatch(AbstractJavaResourceMethodDispatcher.java:99) [jersey-server-2.25.1.jar:?]
        at org.glassfish.jersey.server.model.ResourceMethodInvoker.invoke(ResourceMethodInvoker.java:389) [jersey-server-2.25.1.jar:?]
        at org.glassfish.jersey.server.model.ResourceMethodInvoker.apply(ResourceMethodInvoker.java:347) [jersey-server-2.25.1.jar:?]
        at org.glassfish.jersey.server.model.ResourceMethodInvoker.apply(ResourceMethodInvoker.java:102) [jersey-server-2.25.1.jar:?]
        at org.glassfish.jersey.server.ServerRuntime$2.run(ServerRuntime.java:326) [jersey-server-2.25.1.jar:?]
        at org.glassfish.jersey.internal.Errors$1.call(Errors.java:271) [jersey-common-2.25.1.jar:?]
        at org.glassfish.jersey.internal.Errors$1.call(Errors.java:267) [jersey-common-2.25.1.jar:?]
        at org.glassfish.jersey.internal.Errors.process(Errors.java:315) [jersey-common-2.25.1.jar:?]
        at org.glassfish.jersey.internal.Errors.process(Errors.java:297) [jersey-common-2.25.1.jar:?]
        at org.glassfish.jersey.internal.Errors.process(Errors.java:267) [jersey-common-2.25.1.jar:?]
        at org.glassfish.jersey.process.internal.RequestScope.runInScope(RequestScope.java:317) [jersey-common-2.25.1.jar:?]
        at org.glassfish.jersey.server.ServerRuntime.process(ServerRuntime.java:305) [jersey-server-2.25.1.jar:?]
        at org.glassfish.jersey.server.ApplicationHandler.handle(ApplicationHandler.java:1154) [jersey-server-2.25.1.jar:?]
        at org.glassfish.jersey.grizzly2.httpserver.GrizzlyHttpContainer.service(GrizzlyHttpContainer.java:384) [jersey-container-grizzly2-http-2.25.1.jar:?]
        at org.glassfish.grizzly.http.server.HttpHandler$1.run(HttpHandler.java:200) [grizzly-http-server-2.4.4.jar:2.4.4]
        at org.glassfish.grizzly.threadpool.AbstractThreadPool$Worker.doWork(AbstractThreadPool.java:569) [grizzly-framework-2.4.4.jar:2.4.4]
        at org.glassfish.grizzly.threadpool.AbstractThreadPool$Worker.run(AbstractThreadPool.java:549) [grizzly-framework-2.4.4.jar:2.4.4]
        at java.lang.Thread.run(Thread.java:748) [?:1.8.0_181]
2020-12-25 11:20:31 262071237 [grizzly-http-server-37] [WARN ] com.baidu.hugegraph.backend.store.hbase.HbaseStore [] - Failed to enable table 'g_ii' of 'g' store
org.apache.hadoop.hbase.TableNotFoundException: daas:g_ii
        at org.apache.hadoop.hbase.client.HBaseAdmin$42.rpcCall(HBaseAdmin.java:2048) ~[hbase-client-2.0.6.jar:2.0.6]
        at org.apache.hadoop.hbase.client.HBaseAdmin$42.rpcCall(HBaseAdmin.java:2044) ~[hbase-client-2.0.6.jar:2.0.6]
        at org.apache.hadoop.hbase.client.RpcRetryingCallable.call(RpcRetryingCallable.java:58) ~[hbase-client-2.0.6.jar:2.0.6]
        at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:107) ~[hbase-client-2.0.6.jar:2.0.6]
        at org.apache.hadoop.hbase.client.HBaseAdmin.executeCallable(HBaseAdmin.java:3084) ~[hbase-client-2.0.6.jar:2.0.6]
        at org.apache.hadoop.hbase.client.HBaseAdmin.executeCallable(HBaseAdmin.java:3076) ~[hbase-client-2.0.6.jar:2.0.6]
        at org.apache.hadoop.hbase.client.HBaseAdmin.checkTableExists(HBaseAdmin.java:2044) ~[hbase-client-2.0.6.jar:2.0.6]
        at org.apache.hadoop.hbase.client.HBaseAdmin.isTableEnabled(HBaseAdmin.java:971) ~[hbase-client-2.0.6.jar:2.0.6]
        at com.baidu.hugegraph.backend.store.hbase.HbaseSessions.enableTable(HbaseSessions.java:246) ~[hugegraph-hbase-0.11.2.jar:?]
        at com.baidu.hugegraph.backend.store.hbase.HbaseStore.enableTables(HbaseStore.java:395) [hugegraph-hbase-0.11.2.jar:?]
        at com.baidu.hugegraph.backend.store.hbase.HbaseStore.truncate(HbaseStore.java:384) [hugegraph-hbase-0.11.2.jar:?]
        at com.baidu.hugegraph.backend.store.AbstractBackendStoreProvider.truncate(AbstractBackendStoreProvider.java:136) [hugegraph-core-0.11.2.jar:0.11.2.0]
        at com.baidu.hugegraph.StandardHugeGraph.truncateBackend(StandardHugeGraph.java:306) [hugegraph-core-0.11.2.jar:0.11.2.0]
        at com.baidu.hugegraph.api.profile.GraphsAPI.clear(GraphsAPI.java:137) [hugegraph-api-0.11.2.jar:0.58.0.0]
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_181]
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_181]
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_181]
        at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_181]
        at org.glassfish.jersey.server.model.internal.ResourceMethodInvocationHandlerFactory$1.invoke(ResourceMethodInvocationHandlerFactory.java:81) [jersey-server-2.25.1.jar:?]
        at org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher$1.run(AbstractJavaResourceMethodDispatcher.java:144) [jersey-server-2.25.1.jar:?]
        at org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher.invoke(AbstractJavaResourceMethodDispatcher.java:161) [jersey-server-2.25.1.jar:?]
        at org.glassfish.jersey.server.model.internal.JavaResourceMethodDispatcherProvider$VoidOutInvoker.doDispatch(JavaResourceMethodDispatcherProvider.java:143) [jersey-server-2.25.1.jar:?]
        at org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher.dispatch(AbstractJavaResourceMethodDispatcher.java:99) [jersey-server-2.25.1.jar:?]
        at org.glassfish.jersey.server.model.ResourceMethodInvoker.invoke(ResourceMethodInvoker.java:389) [jersey-server-2.25.1.jar:?]
        at org.glassfish.jersey.server.model.ResourceMethodInvoker.apply(ResourceMethodInvoker.java:347) [jersey-server-2.25.1.jar:?]
        at org.glassfish.jersey.server.model.ResourceMethodInvoker.apply(ResourceMethodInvoker.java:102) [jersey-server-2.25.1.jar:?]
        at org.glassfish.jersey.server.ServerRuntime$2.run(ServerRuntime.java:326) [jersey-server-2.25.1.jar:?]
        at org.glassfish.jersey.internal.Errors$1.call(Errors.java:271) [jersey-common-2.25.1.jar:?]
        at org.glassfish.jersey.internal.Errors$1.call(Errors.java:267) [jersey-common-2.25.1.jar:?]
        at org.glassfish.jersey.internal.Errors.process(Errors.java:315) [jersey-common-2.25.1.jar:?]
        at org.glassfish.jersey.internal.Errors.process(Errors.java:297) [jersey-common-2.25.1.jar:?]
        at org.glassfish.jersey.internal.Errors.process(Errors.java:267) [jersey-common-2.25.1.jar:?]
        at org.glassfish.jersey.process.internal.RequestScope.runInScope(RequestScope.java:317) [jersey-common-2.25.1.jar:?]
        at org.glassfish.jersey.server.ServerRuntime.process(ServerRuntime.java:305) [jersey-server-2.25.1.jar:?]
        at org.glassfish.jersey.server.ApplicationHandler.handle(ApplicationHandler.java:1154) [jersey-server-2.25.1.jar:?]
        at org.glassfish.jersey.grizzly2.httpserver.GrizzlyHttpContainer.service(GrizzlyHttpContainer.java:384) [jersey-container-grizzly2-http-2.25.1.jar:?]
        at org.glassfish.grizzly.http.server.HttpHandler$1.run(HttpHandler.java:200) [grizzly-http-server-2.4.4.jar:2.4.4]
        at org.glassfish.grizzly.threadpool.AbstractThreadPool$Worker.doWork(AbstractThreadPool.java:569) [grizzly-framework-2.4.4.jar:2.4.4]
        at org.glassfish.grizzly.threadpool.AbstractThreadPool$Worker.run(AbstractThreadPool.java:549) [grizzly-framework-2.4.4.jar:2.4.4]
        at java.lang.Thread.run(Thread.java:748) [?:1.8.0_181]
2020-12-25 11:20:31 262071239 [grizzly-http-server-37] [WARN ] com.baidu.hugegraph.backend.store.hbase.HbaseStore [] - Failed to enable table 'g_li' of 'g' store
org.apache.hadoop.hbase.TableNotFoundException: daas:g_li
        at org.apache.hadoop.hbase.client.HBaseAdmin$42.rpcCall(HBaseAdmin.java:2048) ~[hbase-client-2.0.6.jar:2.0.6]
        at org.apache.hadoop.hbase.client.HBaseAdmin$42.rpcCall(HBaseAdmin.java:2044) ~[hbase-client-2.0.6.jar:2.0.6]
        at org.apache.hadoop.hbase.client.RpcRetryingCallable.call(RpcRetryingCallable.java:58) ~[hbase-client-2.0.6.jar:2.0.6]
        at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:107) ~[hbase-client-2.0.6.jar:2.0.6]
        at org.apache.hadoop.hbase.client.HBaseAdmin.executeCallable(HBaseAdmin.java:3084) ~[hbase-client-2.0.6.jar:2.0.6]
        at org.apache.hadoop.hbase.client.HBaseAdmin.executeCallable(HBaseAdmin.java:3076) ~[hbase-client-2.0.6.jar:2.0.6]
        at org.apache.hadoop.hbase.client.HBaseAdmin.checkTableExists(HBaseAdmin.java:2044) ~[hbase-client-2.0.6.jar:2.0.6]
        at org.apache.hadoop.hbase.client.HBaseAdmin.isTableEnabled(HBaseAdmin.java:971) ~[hbase-client-2.0.6.jar:2.0.6]
        at com.baidu.hugegraph.backend.store.hbase.HbaseSessions.enableTable(HbaseSessions.java:246) ~[hugegraph-hbase-0.11.2.jar:?]
        at com.baidu.hugegraph.backend.store.hbase.HbaseStore.enableTables(HbaseStore.java:395) [hugegraph-hbase-0.11.2.jar:?]
        at com.baidu.hugegraph.backend.store.hbase.HbaseStore.truncate(HbaseStore.java:384) [hugegraph-hbase-0.11.2.jar:?]
        at com.baidu.hugegraph.backend.store.AbstractBackendStoreProvider.truncate(AbstractBackendStoreProvider.java:136) [hugegraph-core-0.11.2.jar:0.11.2.0]
        at com.baidu.hugegraph.StandardHugeGraph.truncateBackend(StandardHugeGraph.java:306) [hugegraph-core-0.11.2.jar:0.11.2.0]
        at com.baidu.hugegraph.api.profile.GraphsAPI.clear(GraphsAPI.java:137) [hugegraph-api-0.11.2.jar:0.58.0.0]
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_181]
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_181]
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_181]
        at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_181]
        at org.glassfish.jersey.server.model.internal.ResourceMethodInvocationHandlerFactory$1.invoke(ResourceMethodInvocationHandlerFactory.java:81) [jersey-server-2.25.1.jar:?]
        at org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher$1.run(AbstractJavaResourceMethodDispatcher.java:144) [jersey-server-2.25.1.jar:?]
        at org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher.invoke(AbstractJavaResourceMethodDispatcher.java:161) [jersey-server-2.25.1.jar:?]
        at org.glassfish.jersey.server.model.internal.JavaResourceMethodDispatcherProvider$VoidOutInvoker.doDispatch(JavaResourceMethodDispatcherProvider.java:143) [jersey-server-2.25.1.jar:?]
        at org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher.dispatch(AbstractJavaResourceMethodDispatcher.java:99) [jersey-server-2.25.1.jar:?]
        at org.glassfish.jersey.server.model.ResourceMethodInvoker.invoke(ResourceMethodInvoker.java:389) [jersey-server-2.25.1.jar:?]
        at org.glassfish.jersey.server.model.ResourceMethodInvoker.apply(ResourceMethodInvoker.java:347) [jersey-server-2.25.1.jar:?]
        at org.glassfish.jersey.server.model.ResourceMethodInvoker.apply(ResourceMethodInvoker.java:102) [jersey-server-2.25.1.jar:?]
        at org.glassfish.jersey.server.ServerRuntime$2.run(ServerRuntime.java:326) [jersey-server-2.25.1.jar:?]
        at org.glassfish.jersey.internal.Errors$1.call(Errors.java:271) [jersey-common-2.25.1.jar:?]
        at org.glassfish.jersey.internal.Errors$1.call(Errors.java:267) [jersey-common-2.25.1.jar:?]
        at org.glassfish.jersey.internal.Errors.process(Errors.java:315) [jersey-common-2.25.1.jar:?]
        at org.glassfish.jersey.internal.Errors.process(Errors.java:297) [jersey-common-2.25.1.jar:?]
        at org.glassfish.jersey.internal.Errors.process(Errors.java:267) [jersey-common-2.25.1.jar:?]
        at org.glassfish.jersey.process.internal.RequestScope.runInScope(RequestScope.java:317) [jersey-common-2.25.1.jar:?]
        at org.glassfish.jersey.server.ServerRuntime.process(ServerRuntime.java:305) [jersey-server-2.25.1.jar:?]
        at org.glassfish.jersey.server.ApplicationHandler.handle(ApplicationHandler.java:1154) [jersey-server-2.25.1.jar:?]
        at org.glassfish.jersey.grizzly2.httpserver.GrizzlyHttpContainer.service(GrizzlyHttpContainer.java:384) [jersey-container-grizzly2-http-2.25.1.jar:?]
        at org.glassfish.grizzly.http.server.HttpHandler$1.run(HttpHandler.java:200) [grizzly-http-server-2.4.4.jar:2.4.4]
        at org.glassfish.grizzly.threadpool.AbstractThreadPool$Worker.doWork(AbstractThreadPool.java:569) [grizzly-framework-2.4.4.jar:2.4.4]
        at org.glassfish.grizzly.threadpool.AbstractThreadPool$Worker.run(AbstractThreadPool.java:549) [grizzly-framework-2.4.4.jar:2.4.4]
        at java.lang.Thread.run(Thread.java:748) [?:1.8.0_181]
2020-12-25 11:20:31 262071242 [grizzly-http-server-37] [WARN ] com.baidu.hugegraph.backend.store.hbase.HbaseStore [] - Failed to enable table 'g_ei' of 'g' store
org.apache.hadoop.hbase.TableNotFoundException: daas:g_ei
        at org.apache.hadoop.hbase.client.HBaseAdmin$42.rpcCall(HBaseAdmin.java:2048) ~[hbase-client-2.0.6.jar:2.0.6]
        at org.apache.hadoop.hbase.client.HBaseAdmin$42.rpcCall(HBaseAdmin.java:2044) ~[hbase-client-2.0.6.jar:2.0.6]
        at org.apache.hadoop.hbase.client.RpcRetryingCallable.call(RpcRetryingCallable.java:58) ~[hbase-client-2.0.6.jar:2.0.6]
        at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:107) ~[hbase-client-2.0.6.jar:2.0.6]
        at org.apache.hadoop.hbase.client.HBaseAdmin.executeCallable(HBaseAdmin.java:3084) ~[hbase-client-2.0.6.jar:2.0.6]
        at org.apache.hadoop.hbase.client.HBaseAdmin.executeCallable(HBaseAdmin.java:3076) ~[hbase-client-2.0.6.jar:2.0.6]
        at org.apache.hadoop.hbase.client.HBaseAdmin.checkTableExists(HBaseAdmin.java:2044) ~[hbase-client-2.0.6.jar:2.0.6]
        at org.apache.hadoop.hbase.client.HBaseAdmin.isTableEnabled(HBaseAdmin.java:971) ~[hbase-client-2.0.6.jar:2.0.6]
        at com.baidu.hugegraph.backend.store.hbase.HbaseSessions.enableTable(HbaseSessions.java:246) ~[hugegraph-hbase-0.11.2.jar:?]
        at com.baidu.hugegraph.backend.store.hbase.HbaseStore.enableTables(HbaseStore.java:395) [hugegraph-hbase-0.11.2.jar:?]
        at com.baidu.hugegraph.backend.store.hbase.HbaseStore.truncate(HbaseStore.java:384) [hugegraph-hbase-0.11.2.jar:?]
        at com.baidu.hugegraph.backend.store.AbstractBackendStoreProvider.truncate(AbstractBackendStoreProvider.java:136) [hugegraph-core-0.11.2.jar:0.11.2.0]
        at com.baidu.hugegraph.StandardHugeGraph.truncateBackend(StandardHugeGraph.java:306) [hugegraph-core-0.11.2.jar:0.11.2.0]
        at com.baidu.hugegraph.api.profile.GraphsAPI.clear(GraphsAPI.java:137) [hugegraph-api-0.11.2.jar:0.58.0.0]
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_181]
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_181]
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_181]
        at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_181]
        at org.glassfish.jersey.server.model.internal.ResourceMethodInvocationHandlerFactory$1.invoke(ResourceMethodInvocationHandlerFactory.java:81) [jersey-server-2.25.1.jar:?]
        at org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher$1.run(AbstractJavaResourceMethodDispatcher.java:144) [jersey-server-2.25.1.jar:?]
        at org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher.invoke(AbstractJavaResourceMethodDispatcher.java:161) [jersey-server-2.25.1.jar:?]
        at org.glassfish.jersey.server.model.internal.JavaResourceMethodDispatcherProvider$VoidOutInvoker.doDispatch(JavaResourceMethodDispatcherProvider.java:143) [jersey-server-2.25.1.jar:?]
        at org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher.dispatch(AbstractJavaResourceMethodDispatcher.java:99) [jersey-server-2.25.1.jar:?]
        at org.glassfish.jersey.server.model.ResourceMethodInvoker.invoke(ResourceMethodInvoker.java:389) [jersey-server-2.25.1.jar:?]
        at org.glassfish.jersey.server.model.ResourceMethodInvoker.apply(ResourceMethodInvoker.java:347) [jersey-server-2.25.1.jar:?]
        at org.glassfish.jersey.server.model.ResourceMethodInvoker.apply(ResourceMethodInvoker.java:102) [jersey-server-2.25.1.jar:?]
        at org.glassfish.jersey.server.ServerRuntime$2.run(ServerRuntime.java:326) [jersey-server-2.25.1.jar:?]
        at org.glassfish.jersey.internal.Errors$1.call(Errors.java:271) [jersey-common-2.25.1.jar:?]
        at org.glassfish.jersey.internal.Errors$1.call(Errors.java:267) [jersey-common-2.25.1.jar:?]
        at org.glassfish.jersey.internal.Errors.process(Errors.java:315) [jersey-common-2.25.1.jar:?]
        at org.glassfish.jersey.internal.Errors.process(Errors.java:297) [jersey-common-2.25.1.jar:?]
        at org.glassfish.jersey.internal.Errors.process(Errors.java:267) [jersey-common-2.25.1.jar:?]
        at org.glassfish.jersey.process.internal.RequestScope.runInScope(RequestScope.java:317) [jersey-common-2.25.1.jar:?]
        at org.glassfish.jersey.server.ServerRuntime.process(ServerRuntime.java:305) [jersey-server-2.25.1.jar:?]
        at org.glassfish.jersey.server.ApplicationHandler.handle(ApplicationHandler.java:1154) [jersey-server-2.25.1.jar:?]
        at org.glassfish.jersey.grizzly2.httpserver.GrizzlyHttpContainer.service(GrizzlyHttpContainer.java:384) [jersey-container-grizzly2-http-2.25.1.jar:?]
        at org.glassfish.grizzly.http.server.HttpHandler$1.run(HttpHandler.java:200) [grizzly-http-server-2.4.4.jar:2.4.4]
        at org.glassfish.grizzly.threadpool.AbstractThreadPool$Worker.doWork(AbstractThreadPool.java:569) [grizzly-framework-2.4.4.jar:2.4.4]
        at org.glassfish.grizzly.threadpool.AbstractThreadPool$Worker.run(AbstractThreadPool.java:549) [grizzly-framework-2.4.4.jar:2.4.4]
        at java.lang.Thread.run(Thread.java:748) [?:1.8.0_181]
2020-12-25 11:20:31 262071244 [grizzly-http-server-37] [WARN ] com.baidu.hugegraph.backend.store.hbase.HbaseStore [] - Failed to enable table 'g_ie' of 'g' store
org.apache.hadoop.hbase.TableNotFoundException: daas:g_ie
        at org.apache.hadoop.hbase.client.HBaseAdmin$42.rpcCall(HBaseAdmin.java:2048) ~[hbase-client-2.0.6.jar:2.0.6]
        at org.apache.hadoop.hbase.client.HBaseAdmin$42.rpcCall(HBaseAdmin.java:2044) ~[hbase-client-2.0.6.jar:2.0.6]
        at org.apache.hadoop.hbase.client.RpcRetryingCallable.call(RpcRetryingCallable.java:58) ~[hbase-client-2.0.6.jar:2.0.6]
        at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:107) ~[hbase-client-2.0.6.jar:2.0.6]
        at org.apache.hadoop.hbase.client.HBaseAdmin.executeCallable(HBaseAdmin.java:3084) ~[hbase-client-2.0.6.jar:2.0.6]
        at org.apache.hadoop.hbase.client.HBaseAdmin.executeCallable(HBaseAdmin.java:3076) ~[hbase-client-2.0.6.jar:2.0.6]
        at org.apache.hadoop.hbase.client.HBaseAdmin.checkTableExists(HBaseAdmin.java:2044) ~[hbase-client-2.0.6.jar:2.0.6]
        at org.apache.hadoop.hbase.client.HBaseAdmin.isTableEnabled(HBaseAdmin.java:971) ~[hbase-client-2.0.6.jar:2.0.6]
        at com.baidu.hugegraph.backend.store.hbase.HbaseSessions.enableTable(HbaseSessions.java:246) ~[hugegraph-hbase-0.11.2.jar:?]
        at com.baidu.hugegraph.backend.store.hbase.HbaseStore.enableTables(HbaseStore.java:395) [hugegraph-hbase-0.11.2.jar:?]
        at com.baidu.hugegraph.backend.store.hbase.HbaseStore.truncate(HbaseStore.java:384) [hugegraph-hbase-0.11.2.jar:?]
        at com.baidu.hugegraph.backend.store.AbstractBackendStoreProvider.truncate(AbstractBackendStoreProvider.java:136) [hugegraph-core-0.11.2.jar:0.11.2.0]
        at com.baidu.hugegraph.StandardHugeGraph.truncateBackend(StandardHugeGraph.java:306) [hugegraph-core-0.11.2.jar:0.11.2.0]
        at com.baidu.hugegraph.api.profile.GraphsAPI.clear(GraphsAPI.java:137) [hugegraph-api-0.11.2.jar:0.58.0.0]
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_181]
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_181]
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_181]
        at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_181]

image

imbajin commented 3 years ago

目前建议还是先写个简单的清除脚本, 直接在 hbase-shell 层面获取所需表后, 进行手动 truncate 或者 truncate_preserve (保留region结构)

这样先满足测试的要求, 而且你想只清除某一些数据表 (保留schema表) 这样做也可以很简单做到

等之后这块分析清楚, 再使用图提供的clear吧

tmljob commented 3 years ago

目前建议还是先写个简单的清除脚本, 直接在 hbase-shell 层面获取所需表后, 进行手动 truncate 或者 truncate_preserve (保留region结构)

这样先满足测试的要求, 而且你想只清除某一些数据表 (保留schema表) 这样做也可以很简单做到

等之后这块分析清楚, 再使用图提供的clear吧

好的，这个能说明下哪些表是schema元数据定义相关的嘛？

因为分不清这些表的含义，我不知道怎么针对性的清空哪些表。目前我是在脚本里面先 disable_all -> drop_all这个库的所有表，然后再运行 init-store.sh来完成重建的。

imbajin commented 3 years ago

好的，这个能说明下哪些表是schema元数据定义相关的嘛？

因为分不清这些表的含义，我不知道怎么针对性的清空哪些表。目前我是在脚本里面先 disable_all -> drop_all这个库的所有表，然后再运行 init-store.sh来完成重建的。

元数据表里我记得有是否需要初始化的标志位, 而且表也挺多, 你不妨只关注数据表, 就 v / ie / oe / si (点/入边/出边/索引等) 这样就只需要 truncate_presever 这几张表. (前提是Schema保持不变, 只清空点边索引数据)

这个很好确定, scan一下就知道了, 如果是不需要表结构, 或者你希望schema也全清, 直接 drop_all 可能更简单

github-actions[bot] commented 3 years ago

Due to the lack of activity, the current issue is marked as stale and will be closed after 20 days, any update will remove the stale label