-
I don't believe that all of the requirements to use `spark-ec2` with an existing VPC & subnet are documented. If I create a VPC & subnet, then use those to run `spark-ec2` as documented [here](https:…
-
In the documentation there is a broken link reference:
"If you wish to start a cluster using Spark, please refer to http://spark-project.org/docs/latest/ec2-scripts.html"
-
## Bug
#### Which Delta project/connector is this regarding?
I am working with Delta Lake 3.1.0 and Spark 3.5.1.
### Describe the problem
I am experimenting with Delta Lake as the prima…
-
How do I run commands from the `spark-shell` so that they are executed on Lambda? Right now, the commands are being executed locally on my machine, but I would like Lambda to be the backend.
I am r…
-
## Expected behavior
## Actual behavior
## Steps to reproduce the problem
## Settings
Sedona version = ?
Apache Spark version = ?
Apache Flink version = ?
API type = Scala, Java, …
-
Hey guys,
I m trying to run the command: ./spark-ec2 -i -k --copy launch amplab-training from your Big-Data Mini Course.
I have downloaded my US East key pair and also called it ampcamp, so my …
-
I am blocked on accessing EC2 with thunder-ec2. I have been consistently getting a pssh error at the Anaconda installation step (see below). I have restarted using --resume many times, redid the AWS …
-
Error while launching ec2 spark cluster with HVM (r3.large, r3.xlarge, ...)
xniu7 updated
10 years ago
-
# 서버 구축
## 요구 사항
* 크롤링 스크립트를 데일리 배치로 실행
* 스파크 작업을 실행
## 작업
### 배치 잡 실행
- cron 사용
- jenkins 사용
- github action (조사)
+ https://github.com/zzsza/github-action-with-python
##…
-
Hi,
I have a spark standalone cluster on ec2, and I would like to run java apps using the spark jobserver. I understand that I need to have my app main class extend the SparkJob trait, therefore impl…