OpenLineage / OpenLineage

An Open Standard for lineage metadata collection
http://openlineage.io
Apache License 2.0
1.61k stars 262 forks source link

[INTEGRATION] Ray framework Integration #1715

Open rakeshJn opened 1 year ago

rakeshJn commented 1 year ago

What is the target system?

Ray Framework (https://www.ray.io/)

What kind of integration is this?

How should this integration be implemented?

Ray Framework is an popular framework for distributed processing and training. Many times it is used to to data preprocessing also. The way Spark-Openlineage integration works, there should be similar Ray-Openlineage integration, which could be very useful for end-to-end metadata visibility.

Where should this integration be implemented?

Do you plan to make this contribution yourself?

boring-cyborg[bot] commented 1 year ago

Thanks for creating your first OpenLineage issue! Your feedback is valuable and improves the project. If you haven't already, please be sure to follow the issue template!