search

ucesys / sparkscope

Apache License 2.0
5 stars 2 forks source link

email report not working 🐛 #4

Closed psobczakucesys closed 1 year ago

psobczakucesys commented 1 year ago

https://github.com/qubole/sparklens/issues/59

psobczakucesys commented 1 year ago

When submiting job with spark.sparklens.report.email feature: spark-submit --jars /tmp/sparklens-0.3.2-s_2.11.jar,/tmp/httpmime-4.5.14.jar --conf spark.extraListeners=com.qubole.sparklens.QuboleJobListener --conf spark.driver.extraJavaOptions=-Dderby.system.home=/tmp/derby --class org.apache.spark.examples.SparkPi --master spark://spark-master:7077 --conf spark.eventLog.enabled=true --conf spark.eventLog.dir=/tmp/spark-events --conf spark.sparklens.report.email=piosobc@gmail.com /tmp/examples.jar 1000

Getting the following error and email is not sent: Error while trying to generate email report: Connect to sparklens.qubole.com:80 [sparklens.qubole.com/54.235.255.14] failed: Connection timed out (Connection timed out) Try to use sparklens.qubole.com to generate the report manually

The is due to the fact that sprarklens email generation relies on sparklens.qubole.com endpoint which is down.

psobczakucesys commented 1 year ago

This feature cant be fixed because it relied on qubole external service