awesome-workflow-engines

A curated list of awesome open source workflow engines

Full fledged product

• Activepieces - Open source no-code business automation, alternative to Zapier
• AiiDA - Open source workflow manager for computational science with strong focus on performance, provenance, and extensibility.
• Airflow - Python-based platform for running directed acyclic graphs (DAGs) of tasks
• Argo Workflows - Open source container-native workflow engine for getting work done on Kubernetes
• Arvados - Open Source data and workflow management platform with emphasis on reproducibily, scale, and secure data sharing, deployable on cloud and HPC.
• Azkaban - Batch workflow job scheduler created at LinkedIn to run Hadoop jobs.
• Brigade - Brigade is a tool for running scriptable, automated tasks in the cloud — as part of your Kubernetes cluster.
• CabloyJS - A Node.js full-stack framework with workflow engine, based on koa + egg + vue + framework7.
• Cadence - An orchestration engine to execute asynchronous long-running business logic developed by Uber Engineering.
• Camunda - BPMN-based workflow engine that can be embedded as java library (e.g. Spring Boot) or used standalone, including a graphical modeler and operations tooling.
• CDS - Enterprise-grade continuous delivery & DevOps automation open source platform developped by OVHcloud.
• CGraph - A simple-used and cross-platform DAG framework based on C++17 without any 3rd-party.
• CloudSlang - Workflow engine to automate your DevOps use cases.
• Conductor - Conductor is a microservices orchestration platform that enables developers to build scalable, durable application flows. Conductor workflows are language and framework-agnostic. The Conductor is maintained by Orkes and a team of open-source contributors.
• Copper - A high performance Java workflow engine.
• Couler - Unified interface for constructing and managing workflows on different workflow engines, such as Argo Workflows, Tekton Pipelines, and Apache Airflow.
• Covalent - Workflow orchestration platform for quantum and high performance computing.
• Cromwell - Workflow engine written in Scala and designed for simplicity and scalability. Executes workflows written in WDL or CWL.
• Cylc - Workflow engine that orchestrates complex distributed workflows with cyclic or acyclic graphs. It was originally designed to automate weather forecasting systems at NIWA.
• Dagu - A No-code workflow executor. It executes workflows from declarative YAML definitions.
• Dagster - Data orchestrator for machine learning, analytics, and ETL.
• Dapr Workflows - Author and execute durable & long-running Workflow-as-code at scale in Python, Javascript, .NET, Java & Go. Based on the Open-source Durable Task Framework.
• Didact - The open source .NET job orchestrator.
• DigDag - Digdag is a simple tool that helps you to build, run, schedule, and monitor complex pipelines of tasks.
• DolphinScheduler Apache DolphinScheduler is a distributed and extensible workflow scheduler platform with powerful DAG visual interfaces, dedicated to solving complex job dependencies in the data pipeline and providing various types of jobs available out of box.
• elsa-workflows - A .NET Standard 2.0 Workflows Library.
• easy-rules - The simple, stupid rules engine for Java.
• FireWorks - FireWorks stores, executes, and manages calculation workflows.
• Fission Workflows - A high-perfomant workflow engine for serverless functions on Kubernetes.
• Flor - A workflow engine written in Ruby.
• Flyte - A container-native, type-safe workflow and pipelines platform optimized for large scale processing and machine learning written in Golang. Workflows can be written in any language, with out of the box support for Python.
• ForML - A development framework and MLOps platform for the lifecycle management of data science projects.
• Galaxy Project - Galaxy is a scientific tool and workflow system that facilitates reproducibility and transparency by providing a graphical user interface (GUI), a multitude of computational dataset tools, a rich API, and a robust scientific community.
• Goflow - A simple but powerful DAG scheduler and dashboard, written in Go.
• Huginn - Create agents that monitor and act on your behalf. Your agents are standing by!
• Imixs-Workflow - A powerful human-centric Workflow Engine based on the BPMN 2.0 standard.
• Inngest - An event-driven workflow engine that combines event streams, queues, and durable execution into a single reliability layer.
• iWF - iWF is a WorkflowAsCode API orchestration platform offering an orchestration coding framework and service for building resilient, fault-tolerant, scalable long-running processes.
• Kestra - Open source data orchestration and scheduling platform with declarative syntax.
• Kiba - Data processing & ETL framework for Ruby
• Kubeflow pipelines - Kubeflow pipelines are reusable end-to-end ML workflows built using the Kubeflow Pipelines SDK.
• Laravel Workflow - Laravel Workflow is a durable workflow engine that allows users to track job status, orchestrate microservices and write long running persistent distributed workflows in PHP powered by Laravel Queues.
• Petri Flow - Petri Net workflow engine for Ruby.
• Martian - An elegant, powerful language and framework for building high-performance computational pipelines.
• Metaflow - Metaflow is a human-friendly Python/R library that helps scientists and engineers build and manage real-life data science projects.
• MassTransit - .Net Messaging system with Saga Workflow Support
• Mistral - Workflow service, in OpenStack foundation.
• N8n-io - Free and open node based Workflow Automation Tool. Easily automate tasks across different services.
• Nextflow - Develop container-backed, reproducible workflows portable across computational platforms including local, HPC schedulers, AWS Batch, Google Genomics Pipelines, and Kubernetes.
• Node-RED - Node-RED is a NodeJS based workflow tool featuring a browser based editor for wiring together hardware devices, APIs and online services in new and interesting ways.
• Oozie - Workflow Scheduler for Hadoop.
• Pallets - Simple and reliable workflow engine, written in Ruby
• Parsl - Python framework for workflow orchestration and parallelization based on a dynamic graph of tasks and their data dependencies.
• Pegasus - Automate, recover, and debug scientific computations.
• Piper - A distributed Java workflow engine designed to be dead simple.
• Platformeco - Technology platform, allows Product & Project teams easily build micro services using drag & drop UI and operate it, within out of the box cloud and CI/CD tools with deep tracing & monitoring.
• Plynx - Interactive platform with drag and drop interface for building and deploying portable and scalable end-to-end data driven workflows.
• Popper - Lightweight, YAML based container-native workflow engine supporting Docker, Singularity, Vagrant VMs with Docker daemon in VM, and local host.
• Prefect - Prefect is a new workflow management system, designed for modern infrastructure and powered by the open-source Prefect Core workflow engine
• Restate - A low-latency durable execution engine for workflows, event-driven handlers, transactional state machines, and stateful orchestration. Fully self-contained in a single binary. Supports programs in TypeScript, Java/Kotlin, Go, Python, and Rust.
• River Pro - Postgres-backed workflow engine and web dashboard for the River background queue, written in Go.
• RunDeck - Job Scheduler and Runbook Automation.
• Snakemake - Workflow management system to create reproducible and scalable data analyses; python-based inspired by GNU Make.
• StackStorm - Robust Automation Engine providing Sensors, Triggers, Rules, Workflows, and Actions. StackStorm is how you "glue" your applications together.
• Temporal - Temporal is a microservice orchestration platform which enables developers to build scalable applications without sacrificing productivity or reliability. Temporal is a mature technology, a fork of Uber's Cadence. Temporal is being developed by Temporal Technologies, a startup by the creators of Cadence.
• Titanoboa - Titanoboa is a platform for creating complex workflows on JVM.
• Tork - Tork is a very lightweight workflow engine written in Golang.
• uTask - Automation engine that models and executes business processes declared in yaml.
• Wexflow .NET Workflow Engine and Automation Platform.
• Windmill - Turn scripts into workflows and UIs. Open-source alternative to Airplane and Retool.
• Workflow Engine - A lightweight .NET and Java workflow engine.
• YAWL - (Yet Another Workflow Language), Java-based, handles complex data transformations, and full integration with organizational resources and external Web Services.
• Zeebe - A horizontally scalable, cloud-native workflow engine that executes BPMN models and is best operated on Kubernetes; polyglot clients connect via gRPC or available language clients.

BPM Suite

• Activiti - Activiti is a leading lightweight, java-centric open-source BPMN engine supporting real-world process automation needs.
• Activiti Cloud - is now the new generation of business automation platform offering a set of cloud native building blocks designed to run on distributed infrastructures.
• Bonita - BPMN engine that comes with an optional development environment, a designer, an optional user interface and administrative tools.
• Flowable - The Flowable project provides a core set of open source business process engines that are compact and highly efficient. They provide a workflow and Business Process Management (BPM) platform for developers, system admins and business users.
• jBPM - The core of jBPM is a light-weight, extensible workflow engine written in pure Java that allows you to execute business processes using the latest BPMN 2.0 specification.

SAAS

• AWS Step Functions - Clear workflows for modern applications.
• Azure Logic Apps - Built on a containerized runtime, deploy and run anywhere to increase scale and portability while automating business-critical workflows.
• Braze - Power customer-centric interactions between consumers and brands in real-time.
• Camunda Cloud - A workflow service executing BPMN, providing various language clients, based on the open source project Zeebe .
• Corezoid - Hyperautomation engine.
• Embed Workflow - Simple native workflow builder for your end-users
• Orkes Conductor - Orkes provides Netflix Conductor as a cloud services across all the major cloud providers with enterprise features such as security, integrations and Visual workflow code editor.
• Google Cloud Workflows - Combine Google Cloud services and APIs to build reliable applications, process automation, and data and machine learning pipelines.
• Refinery.io - Serverless IDE that allows you to visually build complex workflows (HTTP APIs, map/reduce, etc) on top of AWS Lambda. Supports writing in Python, Node.js, Golang, Ruby, and other languages.
• Zenaton - Workflow engine for data processes and background jobs available in PHP, Node.js, Python and Ruby.

Library (embedded usage)

• Automatiko - a toolkit to build services and functions based on workflows (primarily BPMN2). Introduces and implements concepts: workflow as a service, workflow as a function and workflow as a function flow.
• C++ Workflow - C++ Parallel Computing and Asynchronous Networking Engine.
• Camunda - BPMN-based workflow engine that can be embedded as java library (e.g. Spring Boot) or used standalone, including a graphical modeler and operations tooling.
• Captain - Distributed, light-weight java workflow engine for a microservice architecture.
• CoreWF - WF runtime ported to work on .NET Core
• Dagger - Dagger is a distributed, horizontally scalable, durable, and highly available orchestration engine in python based on Faust-Streaming for running millions of long running tasks with direct integration with Kafka
• Django River - Django workflow library that supports on the fly changes for states, transitions, and authorizations
• DBOS Transact - DBOS typescript library for writing durable and transactional workflows.
• Durable Task Framework - Durable Task Framework (DTFx) is a library that allows users to write long running persistent workflows in C#.
• Kogito - Cloud-native business automation technology. Embeddable to produce JVM or GraalVM artifacts or interacted through Kafka & REST APIs
• Luigi - Python module that helps you build complex pipelines of batch jobs.
• nFlow - Embeddable JVM-based workflow engine with high availability, fault tolerance, and support for multiple databases. Additional libraries are provided for visualization and REST API.
• Oban - Robust job processing in Elixir, backed by modern PostgreSQL or SQLite3
• SciPipe - A Go library for writing pipelines of Bash commands or Go-code using the dataflow / flow-based programming paradigm.
• SpiffWorkflow - SpiffWorkflow - a BPMN 2.0 workflow engine implemented in pure Python.
• Symfony Workflow - Symfony Workflow component - The Workflow component provides tools for managing a workflow or finite state machine in PHP.
• Unify Flowret - A lightweight Java based workflow / orchestration engine.
• Viewflow - Reusable workflow library that helps organize people collaboration business logic in django applications.
• Workflow Core - Lightweight workflow engine for .NET Standard
• WorkflowEngine.NET - WorkflowEngine.NET - component that adds workflow in your application. It can be fully integrated into your application, or be in the form of a specific service (such as a web service)