search

apache / hop

Hop Orchestration Platform
https://hop.apache.org/
Apache License 2.0
983 stars 352 forks source link

[Feature Request]: Parquet File Output Base File Name Field Select #3242

Open harrisward opened 1 year ago

harrisward commented 1 year ago

What would you like to happen?

At the moment the Base File Name option can only be a static string or a variable. Would be good to be able to use a previous field value instead via a drop down

Issue Priority

Priority: 2

Issue Component

Component: Transforms

mattcasters commented 1 year ago

Could you clarify Harris: do you want to write multiple files or just grab the filename from the first row? It feels like it would be confusing to do the latter.

harrisward commented 1 year ago

I think you are right and it would be the ability to write multiple files.

mattcasters commented 1 year ago

Start a new file each time we get a new filename in the stream of rows?

harrisward commented 1 year ago

I think that makes sense? Leave it up to the user to sort their data :)