issues
search
apache-spark-on-k8s
/
spark
Apache Spark enhanced with native Kubernetes scheduler back-end: NOTE this repository is being ARCHIVED as all new development for the kubernetes scheduler back-end is now on https://github.com/apache/spark/
https://spark.apache.org/
Apache License 2.0
612
stars
118
forks
source link
issues
Newest
Newest
Most commented
Recently updated
Oldest
Least commented
Least recently updated
documentation on resource staging server
#386
luck02
opened
7 years ago
7
Update pom to v0.3.0 of spark-kubernetes
#385
foxish
closed
7 years ago
0
Prometheus support for Spark clusters on Kubernetes - proposed feature
#384
matyix
opened
7 years ago
7
Read classpath entries from SPARK_EXTRA_CLASSPATH on executors.
#383
mccheah
closed
7 years ago
2
add mvn install directions
#382
luck02
closed
7 years ago
5
Cut a new release on spark 2.1.0
#381
foxish
closed
7 years ago
1
Dependency failure on build
#380
luck02
closed
7 years ago
3
[WIP] Use HDFS Delegation Token in driver/executor pods as part of Secure HDFS Support
#379
kimoonkim
closed
7 years ago
3
Retry binding server to random port in the resource staging server test.
#378
mccheah
closed
7 years ago
3
It would be nice to have more motivations for this project in the readme.
#377
mattdornfeld
opened
7 years ago
1
fix submit job errors
#376
FANNG1
closed
7 years ago
0
Fix import order and scalastyle
#375
ash211
closed
7 years ago
0
Add implicit conversions to imports.
#374
mccheah
closed
7 years ago
1
[WIP] Secure HDFS Support
#373
ifilonenko
closed
7 years ago
1
Test submissions using --packages and also with ".pyc enhanced" jars
#372
erikerlandson
opened
7 years ago
1
[Question] why design a resource stage server
#371
FANNG1
closed
7 years ago
4
Interactions with proposed Rescheduler
#370
erikerlandson
opened
7 years ago
0
Launch PySpark Jobs such that Python launches the JVM
#369
ifilonenko
opened
7 years ago
2
spark.executor.instances par seems invalid when it is large
#368
duyanghao
closed
7 years ago
12
set RestartPolicy=Never for executor
#367
honkiko
closed
7 years ago
6
Ongoing edits in regard to [WIP] PR 365
#366
ifilonenko
closed
7 years ago
0
Submission client redesign to use a step-based builder pattern
#365
mccheah
closed
7 years ago
7
Python Bindings for launching PySpark Jobs from the JVM
#364
ifilonenko
closed
7 years ago
8
[WIP] Submission client redesign to use a step-based builder pattern
#363
mccheah
closed
7 years ago
4
Failing submission if submitter-local files are provided, but no reso…
#362
sahilprasad
closed
7 years ago
7
Allow number of executor cores to have fractional values
#361
liyinan926
closed
7 years ago
2
Dynamic Allocation: Too many executors than desired?
#360
varunkatta
closed
7 years ago
9
Support fractional value (e.g., 0.5) for number of executor cores (spark.executor.cores)
#359
liyinan926
closed
7 years ago
1
User-specified node selector on pods
#358
ash211
closed
7 years ago
2
allow spark driver find shuffle pods in specified namespace
#357
honkiko
closed
7 years ago
2
Config for hard cpu limit on pods; default unlimited
#356
FANNG1
closed
7 years ago
5
Add node selectors for driver and executor pods
#355
FANNG1
closed
7 years ago
14
Submission client legibility and maintainability refactors
#354
mccheah
opened
7 years ago
2
Support for Spark Web UI
#353
duyanghao
closed
7 years ago
8
K8s jobs slow due to hard cpu limits
#352
FANNG1
closed
7 years ago
16
Python Bindings for launching PySpark Jobs from the JVM (v1)
#351
ifilonenko
closed
7 years ago
13
Support HDFS rack locality
#350
kimoonkim
closed
7 years ago
11
Support HDFS rack locality
#349
kimoonkim
closed
7 years ago
0
Bypass init-containers if `spark.jars` and `spark.files` is empty or …
#348
chenchun
closed
7 years ago
10
Allow using TrustStore files for TLS connections to API server.
#347
mccheah
closed
7 years ago
3
New API for custom labels and annotations.
#346
mccheah
closed
7 years ago
0
Rebase onto Apache Spark 2.2.0
#345
ash211
closed
7 years ago
3
Fix sbt build.
#344
mccheah
closed
7 years ago
2
Support trustStore JKS files for TLS connections to the API server
#343
mccheah
opened
7 years ago
0
Resource staging server errors with large files
#342
mccheah
opened
7 years ago
4
V0.2 dev
#341
duyanghao
closed
7 years ago
1
Support specify CPU cores and Memory restricts for driver
#340
duyanghao
closed
7 years ago
4
Fail submission if the resource staging server URI isn't present but local files are submitted
#339
mccheah
closed
7 years ago
1
Bypass init-containers if `spark.jars` and `spark.files` is empty or only has `local://` URIs
#338
mccheah
closed
7 years ago
2
Update proposal document on SPARK-18278
#337
mccheah
closed
7 years ago
2
Previous
Next