apache / paimon

Apache Paimon is a lake format that enables building a Realtime Lakehouse Architecture with Flink and Spark for both streaming and batch operations.
https://paimon.apache.org/
Apache License 2.0
2.43k stars 956 forks source link

[Bug] Query service process record repeatedly #4379

Open Shadowell opened 4 weeks ago

Shadowell commented 4 weeks ago

Search before asking

Paimon version

Paimon 0.9

Compute Engine

Flink 1.18

Minimal reproduce step

  1. Create paimon catelog CREATE CATALOG paimon WITH ( 'type'='paimon', 'warehouse'='file:/tmp/paimon' ); USE CATALOG paimon;
  2. Create table and insert one record CREATE TABLE DIM (k INT, v STRING, PRIMARY KEY(k) NOT ENFORCED) WITH ('bucket' = '1', 'deletion-vectors.enabled' = 'true'); INSERT INTO DIM VALUES (1, 'a');
  3. Call Query Service CALL sys.query_service('default.DIM', 1); image image

image

  1. Insert another record INSERT INTO DIM VALUES (2, 'b'); It shows records sent 4 image

What doesn't meet your expectations?

Records sent should consistent with table record count

Anything else?

No response

Are you willing to submit a PR?

liyubin117 commented 10 hours ago

Is there any progress?