oap-project / raydp

RayDP provides simple APIs for running Spark on Ray and integrating Spark with AI libraries.
Apache License 2.0
308 stars 68 forks source link

Data ownership transfer tests fail in Ray 2.4.0 #343

Open kira-lin opened 1 year ago

kira-lin commented 1 year ago

Now ray.data seems to not work when in ray client mode. Functions like ds.show, ds.mean will fail when using ray client, since driver is not connected to raylet (core_worker is None).

I have submitted an issue about this https://github.com/ray-project/ray/issues/34770. But nobody helps so far. We can skip this test in ray client mode for now.