apache / doris-flink-connector

Flink Connector for Apache Doris
https://doris.apache.org/
Apache License 2.0
315 stars 221 forks source link

[Improve]Compatible with previous filter query options #373

Closed JNSimba closed 5 months ago

JNSimba commented 5 months ago

Proposed changes

Issue Number: close #xxx

Problem Summary:

  1. 348 Implemented filter pushdown and projection pushdown

    But in some scenarios, flinksql cannot push down expressions for example

    insert into kafka_sink 
    select * from  doris_source 
    where  sh_pick_dt >=  DATE_FORMAT(TIMESTAMPADD(DAY,-9, CURRENT_TIMESTAMP),'yyyy-MM-dd');
  2. At the same time, many users who upgraded from the previous version cannot upgrade smoothly, so they are compatible with

Checklist(Required)

  1. Does it affect the original behavior: (Yes/No/I Don't know)
  2. Has unit tests been added: (Yes/No/No Need)
  3. Has document been added or modified: (Yes/No/No Need)
  4. Does it need to update dependencies: (Yes/No)
  5. Are there any changes that cannot be rolled back: (Yes/No)

Further comments

If this is a relatively large or complex change, kick off the discussion at dev@doris.apache.org by explaining why you chose the solution you did and what alternatives you considered, etc...