apache / seatunnel

SeaTunnel is a next-generation super high-performance, distributed, massive data integration tool.
https://seatunnel.apache.org/
Apache License 2.0
8.07k stars 1.83k forks source link

[Feature][Connector-V2] connector-file doesn‘t support nullFormat conf #7992

Open dua01 opened 2 weeks ago

dua01 commented 2 weeks ago

Search before asking

Description

I think a nullFormat configuration option for file exports is useful. This feature would allow users to specify how null values should be represented in the exported files. Here are the key benefits of supporting nullFormat:

  1. Data Consistency: Ensures that the exported data remains consistent and predictable across different systems.
  2. Compatibility: Makes the exported data compatible with various data processing tools and databases.
  3. Readability: Improves the readability of the data by using intuitive representations for null values.
  4. Data Cleaning: Helps standardize null value handling, simplifying data preprocessing.
  5. Error Handling: Prevents errors during data import by preprocessing null values

I found a nullValue configuration in org.apache.seatunnel.format.text.TextSerializationSchema#TextSerializationSchema, but it is not being used.

Usage Scenario

No response

Related issues

No response

Are you willing to submit a PR?

Code of Conduct