search

Tencent / TBase

TBase is an enterprise-level distributed HTAP database. Through a single database cluster to provide users with highly consistent distributed database services and high-performance data warehouse services, a set of integrated enterprise-level solutions is formed.
Other
1.38k stars 262 forks source link

nodename:dn001,backend_pid:4997,message:prepared statement ""p_2_7f6b_9_43be6e13"" does not exist" #85

Open ypma opened 3 years ago

ypma commented 3 years ago

i have a tables（3 tables） join query on 2 datanodes ,row count About 3 million,,, but No matter how running Still back

“ERROR: node:dn002, backend_pid:32316, nodename:dn001,backend_pid:4757,message:prepared statement "p_1_12ff_5_2e700ae5" does not exist”

datanode logs，，，

2020-12-09 11:55:07.798 CST,"szjls_dw","szjls",32526,"[local]",5fd04998.7f0e,2,"REMOTE SUBPLAN (coord2:32619) (C:coord2:32619)",2020-12-09 11:50:48 CST,26/999,0,ERROR,XX000,"node:dn001, backend_pid:5059, nodename:dn001,backend_pid:5059,message:start timestamp 14048603525754 is too old to execute, recentCommitTs 14048729172433",,,,,,"Remote Subplan",,,"pgxc:coord2" 2020-12-09 11:55:07.800 CST,"szjls_dw","szjls",32526,"[local]",5fd04998.7f0e,3,"REMOTE SUBPLAN (coord2:32619) (C:coord2:32619)",2020-12-09 11:50:48 CST,26/999,0,LOG,08P01,"pool_recvres return code:1",,,,,,,,,"pgxc:coord2" 2020-12-09 11:55:07.800 CST,"szjls_dw","szjls",32526,"[local]",5fd04998.7f0e,4,"REMOTE SUBPLAN (coord2:32619) (C:coord2:32619)",2020-12-09 11:50:48 CST,26/999,0,LOG,00000,"no message in buffer",,,,,,,,,"pgxc:coord2" 2020-12-09 11:55:07.800 CST,"szjls_dw","szjls",32526,"[local]",5fd04998.7f0e,5,"REMOTE SUBPLAN (coord2:32619) (C:coord2:32619)",2020-12-09 11:50:48 CST,26/999,0,LOG,00000,"Failed to read response from data node:dn002 pid:32598 when ending query for ERROR, node status:0",,,,,,,,,"pgxc:coord2" 2020-12-09 11:55:07.821 CST,"szjls_dw","szjls",32526,"[local]",5fd04998.7f0e,6,"idle in transaction (aborted)",2020-12-09 11:50:48 CST,26/0,0,ERROR,26000,"prepared statement ""p_2_7f6b_9_43be6e13"" does not exist",,,,,,,,,"pgxc:coord2" 2020-12-09 11:55:51.846 CST,,,12766,,5fcfbbad.31de,612,,2020-12-09 01:45:17 CST,,0,LOG,00000,"[pooler stat]client_request_conn_total=0, client_request_from_hashtab=0, client_request_from_thread=0, acquire_conn_from_hashtab=0, acquire_conn_from_hashtab_and_set=0, acquire_conn_from_thread=0, acquire_conn_time=0, each_client_conn_request_cost_time=-nan us",,,,,,,,,""

but above quey running on greenplum 3 nodes MPP cluster。

ypma commented 3 years ago

i have a tables（3 tables） join query on 2 datanodes ,row count About 3 million,,, but No matter how running Still back

“ERROR: node:dn002, backend_pid:32316, nodename:dn001,backend_pid:4757,message:prepared statement "p_1_12ff_5_2e700ae5" does not exist”

datanode logs，，，

2020-12-09 11:55:07.798 CST,"szjls_dw","szjls",32526,"[local]",5fd04998.7f0e,2,"REMOTE SUBPLAN (coord2:32619) (C:coord2:32619)",2020-12-09 11:50:48 CST,26/999,0,ERROR,XX000,"node:dn001, backend_pid:5059, nodename:dn001,backend_pid:5059,message:start timestamp 14048603525754 is too old to execute, recentCommitTs 14048729172433",,,,,,"Remote Subplan",,,"pgxc:coord2" 2020-12-09 11:55:07.800 CST,"szjls_dw","szjls",32526,"[local]",5fd04998.7f0e,3,"REMOTE SUBPLAN (coord2:32619) (C:coord2:32619)",2020-12-09 11:50:48 CST,26/999,0,LOG,08P01,"pool_recvres return code:1",,,,,,,,,"pgxc:coord2" 2020-12-09 11:55:07.800 CST,"szjls_dw","szjls",32526,"[local]",5fd04998.7f0e,4,"REMOTE SUBPLAN (coord2:32619) (C:coord2:32619)",2020-12-09 11:50:48 CST,26/999,0,LOG,00000,"no message in buffer",,,,,,,,,"pgxc:coord2" 2020-12-09 11:55:07.800 CST,"szjls_dw","szjls",32526,"[local]",5fd04998.7f0e,5,"REMOTE SUBPLAN (coord2:32619) (C:coord2:32619)",2020-12-09 11:50:48 CST,26/999,0,LOG,00000,"Failed to read response from data node:dn002 pid:32598 when ending query for ERROR, node status:0",,,,,,,,,"pgxc:coord2" 2020-12-09 11:55:07.821 CST,"szjls_dw","szjls",32526,"[local]",5fd04998.7f0e,6,"idle in transaction (aborted)",2020-12-09 11:50:48 CST,26/0,0,ERROR,26000,"prepared statement ""p_2_7f6b_9_43be6e13"" does not exist",,,,,,,,,"pgxc:coord2" 2020-12-09 11:55:51.846 CST,,,12766,,5fcfbbad.31de,612,,2020-12-09 01:45:17 CST,,0,LOG,00000,"[pooler stat]client_request_conn_total=0, client_request_from_hashtab=0, client_request_from_thread=0, acquire_conn_from_hashtab=0, acquire_conn_from_hashtab_and_set=0, acquire_conn_from_thread=0, acquire_conn_time=0, each_client_conn_request_cost_time=-nan us",,,,,,,,,""

but above quey running on greenplum 3 nodes MPP cluster。

running on greenplum cluster No exception。

JennyJennyChen commented 3 years ago

That's because the parameters "vacuum_delta" are too small.

Please refer " https://github.com/Tencent/TBase/issues/84 " to adjust parameters "vacuum_delta"

ypma commented 3 years ago

@JennyJennyChen but i config "vacuum_delta" from default 100 to 100000，problem remains

JennyJennyChen commented 3 years ago

Adjust vacuum_delta to the maxium time your sql runs in seconds.

ypma commented 3 years ago

vacuum_delta unit is "second"?? but we are not sql runs more than one hours.

JennyJennyChen commented 3 years ago

yes,vacuum_delta unit is "second"
If you can’t solve it after adjusting vacuum_delta, can you provide your test cases and data? Let’s analyze in detail