sipian / prometheus

The Prometheus monitoring system and time series database.
https://prometheus.io/
Apache License 2.0
0 stars 0 forks source link

Demo of automated benchmarking tool on GKE #12

Closed sipian closed 6 years ago

sipian commented 6 years ago

This is a demo of the automated benchmarking tool on GKE. Since the setup is running on a GKE free-credit account, only one instance of prombench can currently run(due to resource constraints).

If someone wants to restart benchmarking, he can comment /benchmark cancel to delete this instance and can then restart benchmarking by commenting /benchmark pr or /benchmark release.

The design details of this tool can be found here The TODO list can be found here

Signed-off-by: Harsh Agarwal cs15btech11019@iith.ac.in

prom-ci-robot commented 6 years ago

@sipian: Welcome to Prometheus Benchmarking Tool.

The two prometheus versions that will be compared are pr-12 and master

The logs can be viewed at the links provided in the GitHub check blocks at the end of this conversation

After successfull deployment, the benchmarking metrics can be viewed at :

To stop the benchmark process comment /benchmark cancel .

In response to [this](https://github.com/sipian/prometheus/pull/12#issuecomment-410002635): >/benchmark Instructions for interacting with me using PR comments are available [here](https://git.k8s.io/community/contributors/guide/pull-requests.md). If you have questions or suggestions related to my behavior, please file an issue against the [kubernetes/test-infra](https://github.com/kubernetes/test-infra/issues/new?title=Prow%20issue:) repository.
sipian commented 6 years ago

/benchmark cancel

prom-ci-robot commented 6 years ago

@sipian: Looks like start-benchmark job is already running on this PR. Will start cancel-benchmark job once ongoing job is completed

In response to [this](https://github.com/sipian/prometheus/pull/12#issuecomment-410003088): >/benchmark cancel Instructions for interacting with me using PR comments are available [here](https://git.k8s.io/community/contributors/guide/pull-requests.md). If you have questions or suggestions related to my behavior, please file an issue against the [kubernetes/test-infra](https://github.com/kubernetes/test-infra/issues/new?title=Prow%20issue:) repository.
prom-ci-robot commented 6 years ago

@sipian: Deletion of prombench failed: Failed to get ProwJob f07c8adc-9677-11e8-b629-0a580a080007 to end start-benchmark: response has status "403 Forbidden" and body "{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"prowjobs.prow.k8s.io \"f07c8adc-9677-11e8-b629-0a580a080007\" is forbidden: User \"system:serviceaccount:default:horologium\" cannot get prowjobs.prow.k8s.io in the namespace \"default\": Unknown user \"system:serviceaccount:default:horologium\"","reason":"Forbidden","details":{"name":"f07c8adc-9677-11e8-b629-0a580a080007","group":"prow.k8s.io","kind":"prowjobs"},"code":403} "

In response to [this](https://github.com/sipian/prometheus/pull/12#issuecomment-410003088): >/benchmark cancel Instructions for interacting with me using PR comments are available [here](https://git.k8s.io/community/contributors/guide/pull-requests.md). If you have questions or suggestions related to my behavior, please file an issue against the [kubernetes/test-infra](https://github.com/kubernetes/test-infra/issues/new?title=Prow%20issue:) repository.
sipian commented 6 years ago

/benchmark cancel

sipian commented 6 years ago

/benchmark 2.1.0

prom-ci-robot commented 6 years ago

@sipian: Welcome to Prometheus Benchmarking Tool.

The two prometheus versions that will be compared are pr-12 and v2.1.0

The logs can be viewed at the links provided in the GitHub check blocks at the end of this conversation

After successfull deployment, the benchmarking metrics can be viewed at :

To stop the benchmark process comment /benchmark cancel .

In response to [this](https://github.com/sipian/prometheus/pull/12#issuecomment-410005396): >/benchmark 2.1.0 Instructions for interacting with me using PR comments are available [here](https://git.k8s.io/community/contributors/guide/pull-requests.md). If you have questions or suggestions related to my behavior, please file an issue against the [kubernetes/test-infra](https://github.com/kubernetes/test-infra/issues/new?title=Prow%20issue:) repository.
prom-ci-robot commented 6 years ago

@sipian: Looks like cancel-benchmark job is already running on this PR. Will start start-benchmark job once ongoing job is completed

In response to [this](https://github.com/sipian/prometheus/pull/12#issuecomment-410005396): >/benchmark 2.1.0 Instructions for interacting with me using PR comments are available [here](https://git.k8s.io/community/contributors/guide/pull-requests.md). If you have questions or suggestions related to my behavior, please file an issue against the [kubernetes/test-infra](https://github.com/kubernetes/test-infra/issues/new?title=Prow%20issue:) repository.
sipian commented 6 years ago

/benchmark master

prom-ci-robot commented 6 years ago

@sipian: Looks like a job is already lined up for this PR.
Please try again once all pending jobs have finished :smiley:

In response to [this](https://github.com/sipian/prometheus/pull/12#issuecomment-410005764): >/benchmark master Instructions for interacting with me using PR comments are available [here](https://git.k8s.io/community/contributors/guide/pull-requests.md). If you have questions or suggestions related to my behavior, please file an issue against the [kubernetes/test-infra](https://github.com/kubernetes/test-infra/issues/new?title=Prow%20issue:) repository.
sipian commented 6 years ago

/benchmark cancel

sipian commented 6 years ago

/benchmark 2.1.0

prom-ci-robot commented 6 years ago

@sipian: Welcome to Prometheus Benchmarking Tool.

The two prometheus versions that will be compared are pr-12 and v2.1.0

The logs can be viewed at the links provided in the GitHub check blocks at the end of this conversation

After successfull deployment, the benchmarking metrics can be viewed at :

To stop the benchmark process comment /benchmark cancel .

In response to [this](https://github.com/sipian/prometheus/pull/12#issuecomment-410434354): >/benchmark 2.1.0 Instructions for interacting with me using PR comments are available [here](https://git.k8s.io/community/contributors/guide/pull-requests.md). If you have questions or suggestions related to my behavior, please file an issue against the [kubernetes/test-infra](https://github.com/kubernetes/test-infra/issues/new?title=Prow%20issue:) repository.
sipian commented 6 years ago

/benchmark cancel

prom-ci-robot commented 6 years ago

Alertmanager URL: http://alertmanager-84658b9955-ttvb8:9093

TODO: add graph url from annotations.

prom-ci-robot commented 6 years ago

Alertmanager URL: http://35.237.152.93/alertmanager

TODO: add graph url from annotations.