oap-project / raydp

RayDP provides simple APIs for running Spark on Ray and integrating Spark with AI libraries.
Apache License 2.0
308 stars 68 forks source link

[raydp-321] Prepend ":job_id:<jobid>" to java-worker-<jobid>-<pid>.log to avoid too many executor logs flushed to shell console #323

Closed jiafuzha closed 1 year ago

jiafuzha commented 1 year ago

We still need to prepend job id to log file with ray 2.3 until #33665 is released.

jiafuzha commented 1 year ago

@kira-lin please help review the code. thanks