intel / cloud-native-ai-pipeline

AI cloud native pipeline for confidential and sustainable computing
https://intel.github.io/cloud-native-ai-pipeline/
Apache License 2.0
37 stars 15 forks source link

keda: add the keda scale job for inference based on drop fps #130

Closed leyao-daily closed 1 year ago

leyao-daily commented 1 year ago

This is to add the keda scale job based on inference drop fps, and example will increase the inference deployment replicas when sum drop fps larger than 5.