teragrep / pth_10

Data Processing Language (DPL) translator for Apache Spark
GNU Affero General Public License v3.0
0 stars 2 forks source link

hdfs save creates empty files for empty dataset #266

Open eemhu opened 2 months ago

eemhu commented 2 months ago

Description

Seems like hdfs save with csv format creates empty csv files for empty datasets. These empty datasets should not create any files

Use case or motivation behind the feature request

It is confusing to have multiple empty files created for no data

Related issues

Additional context