Netflix / mantis

A platform that makes it easy for developers to build realtime, cost-effective, operations-focused applications
Apache License 2.0
1.42k stars 202 forks source link

Introduce job autoscaler manager #680

Closed hmitnflx closed 4 months ago

hmitnflx commented 5 months ago

Context

This will allow runtime control over autoscaler, toggling on/off decisions to scale up and scale down a mantis job stage. A use-case for this could be disabling autoscaler during a failover period to disable scale down.

Checklist

github-actions[bot] commented 5 months ago

Test Results

533 tests  ±0   527 :white_check_mark: ±0   7m 52s :stopwatch: -1s 139 suites ±0     6 :zzz: ±0  139 files   ±0     0 :x: ±0 

Results for commit de3f214a. ± Comparison against base commit 5b63907a.

:recycle: This comment has been updated with latest results.

github-actions[bot] commented 4 months ago

Uploaded Artifacts

To use these artifacts in your Gradle project, paste the following lines in your build.gradle.

resolutionStrategy {
    force "io.mantisrx:mantis-discovery-proto:0.1.0-20240704.074337-543"
    force "io.mantisrx:mantis-client:0.1.0-20240704.074337-544"
    force "io.mantisrx:mantis-network:0.1.0-20240704.074337-543"
    force "io.mantisrx:mantis-remote-observable:0.1.0-20240704.074337-544"
    force "io.mantisrx:mantis-common-serde:0.1.0-20240704.074337-543"
    force "io.mantisrx:mantis-runtime:0.1.0-20240704.074337-544"
    force "io.mantisrx:mantis-runtime-executor:0.1.0-20240704.074337-79"
    force "io.mantisrx:mantis-common:0.1.0-20240704.074337-543"
    force "io.mantisrx:mantis-runtime-loader:0.1.0-20240704.074337-544"
    force "io.mantisrx:mantis-connector-iceberg:0.1.0-20240704.074337-542"
    force "io.mantisrx:mantis-rxcontrol:0.1.0-20240704.074337-17"
    force "io.mantisrx:mantis-testcontainers:0.1.0-20240704.074337-213"
    force "io.mantisrx:mantis-connector-kafka:0.1.0-20240704.074337-544"
    force "io.mantisrx:mantis-connector-publish:0.1.0-20240704.074337-543"
    force "io.mantisrx:mantis-control-plane-client:0.1.0-20240704.074337-543"
    force "io.mantisrx:mantis-control-plane-core:0.1.0-20240704.074337-537"
    force "io.mantisrx:mantis-shaded:0.1.0-20240704.074337-542"
    force "io.mantisrx:mantis-connector-job:0.1.0-20240704.074337-544"
    force "io.mantisrx:mantis-examples-groupby-sample:0.1.0-20240704.074337-537"
    force "io.mantisrx:mantis-control-plane-dynamodb:0.1.0-20240704.074337-4"
    force "io.mantisrx:mantis-examples-core:0.1.0-20240704.074337-537"
    force "io.mantisrx:mantis-examples-jobconnector-sample:0.1.0-20240704.074337-537"
    force "io.mantisrx:mantis-control-plane-server:0.1.0-20240704.074337-537"
    force "io.mantisrx:mantis-examples-sine-function:0.1.0-20240704.074337-537"
    force "io.mantisrx:mantis-examples-synthetic-sourcejob:0.1.0-20240704.074337-537"
    force "io.mantisrx:mantis-examples-mantis-publish-sample:0.1.0-20240704.074337-537"
    force "io.mantisrx:mantis-publish-netty:0.1.0-20240704.074337-536"
    force "io.mantisrx:mantis-publish-netty-guice:0.1.0-20240704.074337-537"
    force "io.mantisrx:mantis-examples-twitter-sample:0.1.0-20240704.074337-537"
    force "io.mantisrx:mantis-publish-core:0.1.0-20240704.074337-537"
    force "io.mantisrx:mantis-examples-wordcount:0.1.0-20240704.074337-537"
    force "io.mantisrx:mantis-server-worker-client:0.1.0-20240704.074337-537"
    force "io.mantisrx:mantis-source-job-kafka:0.1.0-20240704.074337-537"
    force "io.mantisrx:mantis-control-plane-store-dynamodb:0.1.0-20240704.074337-31"
    force "io.mantisrx:mantis-source-job-publish:0.1.0-20240704.074337-537"
    force "io.mantisrx:mantis-server-agent:0.1.0-20240704.074337-537"
}