OpenTSDB / asynchbase

A fully asynchronous, non-blocking, thread-safe, high-performance HBase client.
https://github.com/OpenTSDB/asynchbase
BSD 3-Clause "New" or "Revised" License
610 stars 303 forks source link

AssertionError: "Must not be used." #188

Closed PeterGrace closed 6 years ago

PeterGrace commented 6 years ago

Running an opentsdb cluster in AWS; it's been running fantastic for about 5 days now without incident, using hdfs as the storage medium for a 3-node hbase cluster, with opentsdb running on one of the nodes.

Just saw this below error in the logs for opentsdb and I'm unsure of where I should go from here to try to prevent this, or stop it from happening.

I noticed issue #170 also reports this problem, but I was unsure whether my cause is the same as the cause for 170.

19:51:49.445 ERROR [RegionClient.decode] - Uncaught error during de-serialization of MultiAction(batch=[PutRequest(table="tsdb", key=[0, 2, 98, 90, -124, -121, 48, 0, 0, 2, 0, 0, 27], family="t", qualifiers=["\xC2@"], values=["\x00"], timestamp=15186379
08000, lockid=-1, durable=true, bufferable=true, attempt=2, region=RegionInfo(table="tsdb", region_name="tsdb,\x00\x00\xE8Z|\xE4\x80\x00\x00\x02\x00\x00\x1B\x00\x00\t\x00\x00E\x00\x00\x0B\x00\x00<,1518278479486.87ab3f8d40b01a35bd15c1f44a4c2b77.", stop_k
ey="")), PutRequest(table="tsdb", key=[0, 2, 102, 90, -124, -121, 48, 0, 0, 2, 0, 0, 27], family="t", qualifiers=["\xC2@"], values=["\x00"], timestamp=1518637908000, lockid=-1, durable=true, bufferable=true, attempt=2, region=RegionInfo(table="tsdb", re
gion_name="tsdb,\x00\x00\xE8Z|\xE4\x80\x00\x00\x02\x00\x00\x1B\x00\x00\t\x00\x00E\x00\x00\x0B\x00\x00<,1518278479486.87ab3f8d40b01a35bd15c1f44a4c2b77.", stop_key="")), PutRequest(table="tsdb", key=[0, 2, 100, 90, -124, -121, 48, 0, 0, 2, 0, 0, 27], fami
ly="t", qualifiers=["\xC2@"], values=["\x00"], timestamp=1518637908000, lockid=-1, durable=true, bufferable=true, attempt=2, region=RegionInfo(table="tsdb", region_name="tsdb,\x00\x00\xE8Z|\xE4\x80\x00\x00\x02\x00\x00\x1B\x00\x00\t\x00\x00E\x00\x00\x0B\
x00\x00<,1518278479486.87ab3f8d40b01a35bd15c1f44a4c2b77.", stop_key="")), ... 50 RPCs not shown ..., PutRequest(table="tsdb", key=[0, 0, 19, 90, -124, -121, 48, 0, 0, 1, 0, 0, 1, 0, 0, 2, 0, 0, 27, 0, 0, 3, 0, 0, 26], family="t", qualifiers=["\xC20"], v
alues=["\x00"], timestamp=1518637907000, lockid=-1, durable=true, bufferable=true, attempt=1, region=RegionInfo(table="tsdb", region_name="tsdb,,1518278479486.88a1fb8c2983f7778f8bcf312858f303.", stop_key=[0, 0, -24, 90, 124, -28, -128, 0, 0, 2, 0, 0, 27
, 0, 0, 9, 0, 0, 69, 0, 0, 11, 0, 0, 60]))]), rpcid=0
19:51:49.446 ERROR [RegionClient.exceptionCaught] - Unexpected exception from downstream on [id: 0xb9f6d6e2, /172.31.29.153:34582 => /172.31.29.153:16201]
java.lang.AssertionError: Must not be used.
manolama commented 6 years ago

Fixed in 4aa86790830ce7e5e7e99cce72e3282b80ec514e, thanks!