search

apache / linkis

Apache Linkis builds a computation middleware layer to facilitate connection, governance and orchestration between the upper applications and the underlying data engines.
https://linkis.apache.org/
Apache License 2.0
3.27k stars 1.15k forks source link

[Feature] Add doris engine to linkis #5053

Closed ChengJie1053 closed 6 months ago

ChengJie1053 commented 6 months ago

[Feature] Add doris engine to linkis

Support cvs, json, parquet, orc format file import doris

Submit sample { "executionContent": {"code": "{\"linkis.ec.doris.stream.load.file.path\":\"/Users/chengjie/Downloads/doris/test.csv\",\"linkis.ec.doris.database\":\"demo\",\"linkis.ec.doris.table\":\"example_tbl\"}", "runType": "doris"}, "params": { "variable": {}, "configuration": { "runtime": { "linkis.ec.doris.host":"192.168.201.54", "linkis.ec.doris.2pc.enabled":true,
"linkis.ec.doris.http.port":8030 } } }, "source": {"scriptPath": "file:///mnt/bdp/hadoop/1.sql"}, "labels": { "engineType": "doris-1.2.6", "userCreator": "linkis-IDE" } }

Execution result

image

image

image

image

image

peacewong commented 6 months ago

Thank you, can you use json as code to pass? Parameters that do not apply to runtime Map