-
The `runjobs` management command allows us to group jobs by their schedule (daily, weekly, monthly, etc.), and make one call for the schedule rather than one call for each job. Doing so requires us to…
-
**Used Spark version**
2.2.1
**Used Spark Job Server version**
(Released version, git branch or docker image version)
0.8.0 released
**Deployed mode**
(client/cluster on Spark Standalone/YARN/Me…
-
hi,
To satisfy requirement of business, I have to build developing environment of SparkJobServer on CDH5.7.5. So, on the basis of the original environment, I downgrade the version of akka of master…
YCG09 updated
5 years ago
-
**Used Spark version** = 2.2.0
**Used Spark Job Server version** = git release v.0.8.0
**Deployed mode** = EMR
**Actual (wrong) behavior**
I am trying to write a scala job as well as a pyt…
-
Specify `dependent-jar-uris=hdfs://master:9000/spark/jars/*.jar` to create a context. Got below error
```
"result": {
"message": "unknown protocol: hdfs",
"errorClass": "java.net.Malf…
-
**Used Spark version**
Spark 2.4.7
**Used Spark Job Server version**
v0.6.1
**Deployed mode**
EMR cluster
**Actual (wrong) behavior**
Hi
I was trying to deploy spark-jobserver on a EMR c…
-
For example, `--jobs 4`, `--no-print-directory`,...
-
**TODO:**
- Implement as a scheduler, relying on already implemented solutions: https://github.com/ajvb/kala/blob/master/README.md, https://mesos.github.io/chronos/docs/
- Add a spark-job-observer as…
-
如果有一批spark历史任务想要迁移到jobserver上,可以像阿里云EMR作业提交那样 直接指定参数 (jar路径.main-class.配置信息等) ,然后再jobserver上提交吗
-
There are two main jobs APIs - a POST endpoint for job-runner to provide status on currently running *Jobs*, and a GET endpoint for currently requested *JobRequests*. Job-runner polls the GET API reg…