-
A question for my current use case:
I am wondering if with this setup it is possible to have an S3 bucket with logs divided across subdirectories. For example:
s3://my-bucket/dir1/
s3://my-bucket…
-
extending thoughts in https://github.com/apache-spark-on-k8s/spark/issues/133#issuecomment-282371564
> Currently, we schedule pods in k8s, but in the eventual state we want to get to, we should be …
-
@rerngvit
hello，Your spark configuration is great！！I want to install spark like you did，But I don't know how you installed your spark like
helm install --value values.yaml ??? / ???
Can you tell…
-
I am trying to run the SparkPi command on my kubernetes cluster which has kubernetes 1.8 and following the official documentation.
The command for running looks like this:
```
bin/spark-submit \
…
-
Running historical retrieval with `os.environ["FEAST_SPARK_LAUNCHER"] = "k8s"` breaks due to python compatibility with generated spark python file:
```
kubectl logs feast-m5mz27p6-driver -n spark-…
-
## Steps to reproduce
1. Deploy the Spark K8s bundle with `cos-integration` overlay.
2. Observe the status of Spark History Server. The charm fails with the following error:
```
Traceback (m…
-
I see there are 2 branches K8 and rss-k8, which branch should be used for building jar and image for remote shuffle service for K8 environment?
-
### Code of Conduct
- [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)
### Search before asking
- [X] I have searched in the [issues](http…
-
**Describe the problem you faced**
Hello,when I use hudi's bulkinsert write type, data loss occurs, regardless of the mor table, cow table or any index type. The amount of data in the source table i…
-
I've set up NameNode HA. A problem is that my service will route to either active namenode or standby namenode. For example, I have a Spark History server running with parameter SPARK_HISTORY_OPTS="-D…