SkyAPM / aiops-engine-for-skywalking

This is an incubating repository of the Apache SkyWalking AIOps Engine
https://github.com/apache/skywalking/discussions/8883
Apache License 2.0
37 stars 7 forks source link

[Engine] Ray actor scaler during runtime #28

Closed Superskyyy closed 1 year ago

Superskyyy commented 1 year ago

Data could come in at peak throughout the day, and the stream size in Redis may grow indefinitely, outpacing ray-consuming speed and eventually breaking the application. It's imperative to provide scaling for actors (internal operator), then the autoscaler from Ray will handle the rest (pod scaling)

This issue tracks the creation of a new Ray Actor that manages the creation and destruction of actors during runtime.

Superskyyy commented 1 year ago

Closing in favor of our movement to Flink (built-in support is provided).