Summary - Task Workers

[kymr]

Link

• https://netflix.github.io/conductor/worker/

[kymr]

Background

• Conductor tasks executed by remote workers communicates over HTTP endpoints to poll for the task and updates the status of the execution.
• Conductor provides a framework to poll for tasks, manage the execution thread and update the status of the execution back to the server.
• The framework provides libraries in Java and Python.
• Other language support can be added by using the HTTP endpoints for task management.

[kymr]

Java

• Implement Worker interface to implement the task.
• Use WorkflowTaskCoordinator to register the worker(s) and initialize the polling loop.
  • Sample Worker Implementation
  • Example

WorkflowTaskCoordinator

• Manages the Task workers thread pool and server communication (poll, task update and ack).

Worker

Property	Description
paused	boolean. If set to true, the worker stops polling.
pollCount	No. of tasks to poll for. Used for batched polling. Each task is executed in a separate thread.
longPollTimeout	Time in millisecond for long polling to Conductor server for tasks

• These properties can be set either by Worker implementation or by setting the following system properties in the JVM:

conductor.worker.	Applies to ALL the workers in the JVM
conductor.worker..	Applies to the specified worker. Overrides the global property.