apache / inlong

Apache InLong - a one-stop, full-scenario integration framework for massive data
https://inlong.apache.org/
Apache License 2.0
1.4k stars 530 forks source link

[Bug][Sort] Doris single table columns keyword backticking #8912

Closed Yizhou-Yang closed 7 months ago

Yizhou-Yang commented 1 year ago

What happened

Current doris single table connector does not backtick columns properly, so if it has a column that is keyword (desc,select,insert, etc...), there will be error.

see error like this: 2023-08-15 17:50:36.265 [doris-streamload-output-format-thread-1] INFO org.apache.doris.flink.table.DorisStreamLoad [] - Streamload Response:{"status":200,"respMsg":"OK","respContent":"{\n \"TxnId\": 9157,\n \"Label\": "xxx",\n \"TwoPhaseCommit\": \"false\",\n \"Status\": \"Fail\",\n \"Message\": \"[ANALYSIS_ERROR]errCode = 2, detailMessage = Syntax error in line 1:\n...llerType,orderDate,status,desc,empId,updateDate,haveGr...\n ^\nEncountered: DESC\nExpected: DESC is keyword, maybe DESC\n\",\n \"NumberTotalRows\": 0,\n \"NumberLoadedRows\": 0,\n \"NumberFilteredRows\": 0,\n \"NumberUnselectedRows\": 0,\n \"LoadBytes\": 0,\n \"LoadTimeMs\": 0,\n \"BeginTxnTimeMs\": 0,\n \"StreamLoadPutTimeMs\": 2,\n \"ReadDataTimeMs\": 0,\n \"WriteDataTimeMs\": 0,\n \"CommitAndPublishTimeMs\": 0\n}\n"}

What you expected to happen

backtick columns correctly.

How to reproduce

this only occurs in doris single table scenerios

Environment

No response

InLong version

master

InLong Component

InLong Sort

Are you willing to submit PR?

Code of Conduct

github-actions[bot] commented 1 year ago

This issue is stale because it has been open for 60 days with no activity.