GoogleCloudPlatform / ai-on-gke

AI on GKE is a collection of examples, best-practices, and prebuilt solutions to help build, deploy, and scale AI Platforms on Google Kubernetes Engine
Apache License 2.0
220 stars 165 forks source link

Prometheus Adapter Module #716

Closed Bslabe123 closed 3 months ago

Bslabe123 commented 3 months ago

Module gives us the ability to set the averageValue in a HPA object to the value of a promql query unlike custom metrics stackdriver adapter.

liurupeng commented 3 months ago

could you provide an example of using HBM utilization percentage for HPA with promql on JetStream?

Bslabe123 commented 3 months ago

HBM utilization percentage for HPA with prom

This is configurable in the Jetstream maxtext module which is currently in a separate PR