search

ray-project / mobius

Mobius is an AI infrastructure platform for distributed online learning, including online sample processing, training and serving.
https://ray-project.github.io/mobius/
Apache License 2.0
85 stars 13 forks source link

Is mobius suitable to be used in streaming data processing and model inference？ #59

Closed gtarcoder closed 3 months ago

gtarcoder commented 7 months ago

As title says, I am wondering if this repo is suitable to be used in streaming data processing and model inference? like data processing and inference in Flink

ashione commented 7 months ago

As title says, I am wondering if this repo is suitable to be used in streaming data processing and model inference? like data processing and inference in Flink

Our work might help uesrs to build more close and united system that combines training platform and data processing pipeline based on ray AIR runtime.

gtarcoder commented 7 months ago

As title says, I am wondering if this repo is suitable to be used in streaming data processing and model inference? like data processing and inference in Flink

Our work might help uesrs to build more close and united system that combines training platform and data processing pipeline based on ray AIR runtime.

What is its streaming pattern？ Is it more like spark or flink？

ashione commented 7 months ago

As title says, I am wondering if this repo is suitable to be used in streaming data processing and model inference? like data processing and inference in Flink

Our work might help uesrs to build more close and united system that combines training platform and data processing pipeline based on ray AIR runtime.

What is its streaming pattern？ Is it more like spark or flink？

This doc https://docs.google.com/document/d/1niWddjvgdM0KJwM7vO2Ml4cxcwgKrQsR5a70ehF3K8k/edit might be useful to answer the above question. In fact, we'd better support mainstream APIs contains DSL/DataStreamAPI(Dataflow api, flink and spark both take this, which is called data processing pattern lang) and SQL.

gtarcoder commented 7 months ago

As title says, I am wondering if this repo is suitable to be used in streaming data processing and model inference? like data processing and inference in Flink

Our work might help uesrs to build more close and united system that combines training platform and data processing pipeline based on ray AIR runtime.

What is its streaming pattern？ Is it more like spark or flink？

This doc https://docs.google.com/document/d/1niWddjvgdM0KJwM7vO2Ml4cxcwgKrQsR5a70ehF3K8k/edit might be useful to answer the above question. In fact, we'd better support mainstream APIs contains DSL/DataStreamAPI(Dataflow api, flink and spark both take this, which is called data processing pattern lang) and SQL.

Get， So will this project be maintained continuely? It seems like it hasn't been updated for a long time

ashione commented 3 months ago

As title says, I am wondering if this repo is suitable to be used in streaming data processing and model inference? like data processing and inference in Flink

Our work might help uesrs to build more close and united system that combines training platform and data processing pipeline based on ray AIR runtime.

What is its streaming pattern？ Is it more like spark or flink？

This doc https://docs.google.com/document/d/1niWddjvgdM0KJwM7vO2Ml4cxcwgKrQsR5a70ehF3K8k/edit might be useful to answer the above question. In fact, we'd better support mainstream APIs contains DSL/DataStreamAPI(Dataflow api, flink and spark both take this, which is called data processing pattern lang) and SQL.

Get， So will this project be maintained continuely? It seems like it hasn't been updated for a long time

We need more contributors.