search

apache / paimon

Apache Paimon is a lake format that enables building a Realtime Lakehouse Architecture with Flink and Spark for both streaming and batch operations.
https://paimon.apache.org/
Apache License 2.0
2.4k stars 946 forks source link

[Bug] The consumer-id is not effective when performing multiple table joins. #3343

Open Pandas886 opened 5 months ago

Pandas886 commented 5 months ago

Search before asking

Paimon version

0.8

Compute Engine

flink1.17.2

Minimal reproduce step

In stream processing, specifying the consumer-id for each table does not take effect when performing multiple table joins.

image

I can't see the consumer-id for tables like order_line in the system tables.

image

What doesn't meet your expectations?

I can see the consumer-id of tables like order_line by querying the system tables.

Anything else?

No response

Are you willing to submit a PR?

Pandas886 commented 4 months ago

Is there any progress?

discivigour commented 2 months ago

Hi, @Pandas886 you maybe find some useful info at the flink web job log, if there is some info like "Please set 'table.exec.sink.upsert-materialize' to 'NONE' in Flink's config."，please execute it in flink sql client, then restart your join select.