kestra-io / kestra

:zap: Workflow Automation Platform. Orchestrate & Schedule code in any language, run anywhere, 500+ plugins. Alternative to Zapier, Rundeck, Camunda, Airflow...
https://kestra.io
Apache License 2.0
13.29k stars 1.16k forks source link

Add Apache Camel plugin and implement initial task(s) and trigger(s) #2708

Open anna-geller opened 11 months ago

anna-geller commented 11 months ago

Feature description

Camel supports many useful connectors: https://camel.apache.org/components/4.0.x/index.html

Once concrete use case from the user: use Camel to retrieve users from LDAP, then perform some action (such as scheduling an onboarding workflow for the employee's first day) for each user matching filter criteria.

Early discussions - sth like this would be possible:

id: dropbox_to_bq
namespace: dev

tasks:
  - id: source
    type: io.kestra.plugin.camel.connectors.Dropbox
    from: "dropbox://myfile.csv"
    # to: outputs.source.uri # optional - default internal storage. Alternatively provide the destination to: "s3://kestraio/myfile.csv"

  - id: to_bq
    type: io.kestra.plugin.gcp.bigquery.Load
    from: "{{outputs.source.uri}}"
KoenWindey commented 3 months ago

Hi - I would love a Dropbox connector, is there a status update for the roll-out?