oap-project raydp issues

oap-project / raydp

RayDP provides simple APIs for running Spark on Ray and integrating Spark with AI libraries.

Apache License 2.0

290 stars 66 forks source link

issues

Newest

Newest Most commented Recently updated Oldest Least commented Least recently updated

Fix Spark 3.5.x support + support Spark 3.4.3, deprecate python 3.7+support python 3.10

#411 pang-wu closed 1 week ago
0
Samsara/1.6.0

#410 pang-wu closed 1 week ago
0
incompatible with spark 3.4.3 and 3.5.0

#409 wuxiaocheng0506 opened 3 weeks ago
3
how to init raydp resource

#408 yasaorder opened 1 month ago
1
moved the requirements for python from setup.py to requirements.txt

#407 akashd11 opened 1 month ago
0
moved the requirements for python from setup.py to requirements.txt

#406 akashd11 closed 1 month ago
0
How to develop in intellij?

#405 akashd11 opened 1 month ago
0
raydp.init_spark fails

#404 Mayurji opened 2 months ago
1
Fix CI with latest ray

#403 kira-lin closed 2 months ago
0
install raydp==1.6.0 with pip rasied the "More than one SparkShimProvider found" error

#402 evilpapa opened 3 months ago
0
fix CVE issue

#401 minmingzhu closed 2 months ago
0
fix openssf issue

#400 minmingzhu closed 1 month ago
0
Fix CVE issues

#399 minmingzhu closed 2 months ago
0
Fix OpenSSF issues

#398 minmingzhu closed 1 month ago
0
Support Spark 3.4.2, lift pyspark dependency range

#397 pang-wu closed 6 months ago
2
dynamic allocation executor pending for addition flood fix

#396 raviranak closed 2 months ago
4
Spark 3.5.0 support on raydp

#395 raviranak closed 6 months ago
1
Is it possible for raydp to utilize a Spark session created by Apache Livy?

#394 Taurus-Le opened 6 months ago
1
[stream] does raydp support spark stream data?

#393 fwensen opened 6 months ago
1
Update raydp-submit

#392 gptbert closed 6 months ago
1
Changes for executor actor recovery using ray's fault tolerance.

#391 KiranP-d11 closed 6 months ago
2
RayDP Docker Image with Python 3.10 Failing to Build

#390 dattasoumya92 closed 7 months ago
2
Recovery for lost executors 364

#389 KiranP-d11 closed 7 months ago
9
upgrade Checkpoint usage to fit ray 3.0

#388 harborn closed 2 months ago
1
Feat/recover lost executors

#387 KiranP-d11 closed 7 months ago
2
Issue with Running Multiple Spark Jobs Concurrently on Ray Cluster

#386 DimitarSirakov closed 7 months ago
1
import IPEX in torch config

#385 harborn closed 8 months ago
1
Upgrade snappy version to fix CVE issue

#384 Deegue closed 8 months ago
1
Getting Java gateway process exited before sending its port number during init_spark()

#383 swapkh91 opened 8 months ago
10
Support Spark 3.4.1 and 3.3.3

#382 pang-wu closed 8 months ago
1
Bump org.xerial.snappy:snappy-java from 1.1.10.1 to 1.1.10.4 in /core

#381 dependabot[bot] opened 9 months ago
0
Runtime env_vars cannot be passed down to executors

#380 Deegue opened 9 months ago
1
Update ivy and spark base version

#379 Deegue closed 9 months ago
0
Bump org.apache.ivy:ivy from 2.5.1 to 2.5.2 in /core

#378 dependabot[bot] opened 10 months ago
0
Bump org.apache.spark:spark-core_2.12 from 3.2.2 to 3.3.3 in /core

#377 dependabot[bot] opened 10 months ago
0
Added possibility to set custom actor owner when convert spark dataframe to ray dataset

#376 max-509 closed 8 months ago
3
Add the ability to set the owner of objects when calling _save_spark_df_to_object_store()

#375 max-509 closed 7 months ago
1
Bump to 1.7.0

#374 kira-lin closed 10 months ago
0
Fix Jackson and Scala vulnerabilities

#373 Deegue closed 10 months ago
0
When submit a script another process start locally in the head node

#372 gbraes opened 10 months ago
1
Support ray 2.3.1

#371 fengsp opened 10 months ago
3
[Follow-up] Use OutputStreamWriter instead of FileWriter

#370 Deegue closed 10 months ago
0
[Follow-up] Add charset to getBytes()

#369 Deegue closed 10 months ago
0
[Follow-up] Fix encoding in Agent.java

#368 Deegue closed 11 months ago
0
Fix static code scan

#367 Deegue closed 11 months ago
0
Implement Spark executor node affinity using custom resource

#366 pang-wu closed 11 months ago
7
Use environment variable in maven to build

#365 kira-lin opened 11 months ago
0
Executor lost triggered by JVM OOM can't recover and cause subsequent steps stuck

#364 pang-wu closed 6 months ago
12
[Follow-up] Fix log4j and some dependencies for `shims-common` (#362)

#363 kira-lin closed 11 months ago
0
[Follow-up] Fix log4j and some dependencies for `shims-common`

#362 Deegue closed 11 months ago
2