search

kestra-io / plugin-fs

https://kestra.io/plugins/plugin-fs/
Apache License 2.0
6 stars 7 forks source link

Add the possibility to add mass upload #61

Closed dirkkuyken closed 1 year ago

dirkkuyken commented 1 year ago

Feature description

Description

Currently Kestra allows for uploading files via SFTP/FTP/... , but it only allows to upload a single file per connection Besides the connection only supporting a single upload, it is also required to specify the filename on both from and to locations. In case we want to upload multiple files we'll have to go over each file individually.

Solution

Have the option to provide the from as a folder or have the option to specify an array of files, the to should in both cases point to a directory.

Upload the complete folder

- id: "uploadDir"
  type: "io.kestra.plugin.fs.sftp.Upload"
  host: ftp.server.com
  port: 22
  username: user
  password: secretpassword
  from: "{{outputs.generateArray.**outputDir**}}"
  to: /ftpserver/output/

Upload an array of files

- id: "uploadArray"
  type: "io.kestra.plugin.fs.sftp.Upload"
  host: ftp.server.com
  port: 22
  username: user
  password: secretpassword
  from: "{{outputs.generateArray.**outputFiles**}}"
  to: /ftpserver/output/