Open robvadai opened 7 years ago
The connector produces tiny files on S3, in some cases one message per file. I suspect it's because the file name in every batch is different so it doesn't know that it should append to the previous file.
The connector produces tiny files on S3, in some cases one message per file. I suspect it's because the file name in every batch is different so it doesn't know that it should append to the previous file.