iExec Worker

Overview

The iExec Worker participates in a workerpool by computing tasks purchased by requesters on the iExec marketplace. The iExec Worker must connect to the iExec Core Scheduler of the workerpool to actively participate in the computation.

After registration, the iExec Worker sends a signal to the iExec Core Scheduler at a fixed rate. This signal is used to let the iExec Core Scheduler be aware of the iExec Worker liveness. At the moment, the rate is fixed and this signal is sent every 10 seconds. The iExec Worker will be considered as lost after several failures.

The iExec Worker is available as an OCI image on Docker Hub.

Configuration

You can configure the iExec Worker with the following properties:

Health checks

A health endpoint (/actuator/health) is enabled by default and can be accessed on the IEXEC_WORKER_PORT. This endpoint allows to define health checks in an orchestrator or a compose file. No default strategy has been implemented in the Dockerfile at the moment.

Metrics

A metrics endpoint (/metrics) is available. It currently exposes data on TEE pre-compute, app-compute and TEE post-compute durations in the following form:

{
  "preComputeDurations": {
    "minDuration": 3835.0,
    "maxDuration": 3928.0,
    "averageDuration": 3881.5,
    "durationSamplesCount": 2
  },
  "appComputeDurations": {
    "minDuration": 4349.0,
    "maxDuration": 4349.0,
    "averageDuration": 4349.0,
    "durationSamplesCount": 1
  },
  "postComputeDurations": {
    "minDuration": 16080.0,
    "maxDuration": 16080.0,
    "averageDuration": 16080.0,
    "durationSamplesCount": 1
  },
  "completeComputeDurations": {
    "minDuration": 24264.0,
    "maxDuration": 24264.0,
    "averageDuration": 24264.0,
    "durationSamplesCount": 1
  }
}

These metrics are computed on the latest IEXEC_WORKER_METRICS_WINDOW_SIZE executions of each stage.

All these metrics but complete compute durations can also be exposed on /actuator/prometheus endpoint. In such a case, they are called iexec_{pre_compute|app_compute|post_compute}_duration_{min|max|average|samples_count}.

⚠ As pre-compute is optional, metrics of each stage are not consistent. E.g.: if IEXEC_WORKER_METRICS_WINDOW_SIZE replicates are executed, each of those replicates without any dataset nor input file, then none of the pre-compute durations relates to any of app-compute or post-compute durations. So, treat these metrics with care.

Build from sources

Please first update your config located in ./src/main/resources/application.yml

./gradlew build --refresh-dependencies

License

This repository code is released under the Apache License 2.0.