[Improve] DataFrame CSV Stream Load optimization

apache / doris-spark-connector

Spark Connector for Apache Doris

https://doris.apache.org/

Apache License 2.0

79 stars 92 forks source link

Closed huanccwang closed 11 months ago

huanccwang commented 1 year ago

（csv格式）当datafram进行stream load时，若用户传了columns，则以传参为主，若没有传columns，则默认以df的schema进行隐式传参，这样的好处后续用户在对df进行streamload时，可以直接使用，而不用关心df的schema与底表是否相同。

JNSimba commented 11 months ago

Thank you for your contribution, please resolve the merge conflict

JNSimba commented 11 months ago

ci compilation failed, would you like to take a look?

huanccwang commented 11 months ago

ci compilation failed, would you like to take a look?

done