search

apache / doris-spark-connector

Spark Connector for Apache Doris
https://doris.apache.org/
Apache License 2.0
74 stars 90 forks source link

[improvement] Compatible with arrow serialization type modifications for date/datetime #193

Closed gnehil closed 4 months ago

gnehil commented 4 months ago

Proposed changes

Issue Number: close

Problem Summary:

Compatible with arrow serialization type modifications for date/datetime in the following pr: https://github.com/apache/doris/pull/32281

Checklist(Required)

  1. Does it affect the original behavior: (Yes/No/I Don't know)
  2. Has unit tests been added: (Yes/No/No Need)
  3. Has document been added or modified: (Yes/No/No Need)
  4. Does it need to update dependencies: (Yes/No)
  5. Are there any changes that cannot be rolled back: (Yes/No)

Further comments

If this is a relatively large or complex change, kick off the discussion at dev@doris.apache.org by explaining why you chose the solution you did and what alternatives you considered, etc...

weilai201 commented 3 months ago

Doris 数据库中的datetime类型在spark中无法转换成java Date或Timestamp类型。这个要如何处理？

weilai201 commented 3 months ago

doris-spark-connector是否预留配置或接口，让我自己灵活配置是否需要转换成String类型？