search

krishnan-r / sparkmonitor

Monitor Apache Spark from Jupyter Notebook
https://krishnan-r.github.io/sparkmonitor/
Apache License 2.0
172 stars 55 forks source link

Not Able to Access Spark UI through Monitor #41

Open c-demone opened 3 years ago

c-demone commented 3 years ago

Hello,

Amazing tool! Thank you. Everything is working great except I do not see the icon to open the Spark UI:

image

Here is my Spark configuration:

spark.driver.extraClassPath=/usr/local/tools/spark/sparkmonitor/jars/listener.jar spark.driver.memory=5g spark.eventLog.dir=lustre:///sparkLogging/2.4.4 spark.eventLog.enabled=true spark.eventLog.permissions=777 spark.executor.heartbeatInterval=7500 spark.extraListeners=sparkmonitor.listener.JupyterSparkMonitorListener spark.history.fs.cleaner.enabled=true spark.history.fs.cleaner.interval=1d spark.history.fs.cleaner.maxAge=3d spark.history.fs.logDirectory=lustre:///sparkLogging/2.4.4 spark.kryoserializer.buffer.max=128m spark.master=local[*] spark.network.timeout=10000000 spark.network.timetout=10000000 spark.rdd.compress=True spark.serializer=org.apache.spark.serializer.KryoSerializer spark.serializer.objectStreamReset=100 spark.sql.parquet.enableVectorizedReader=false spark.sql.shuffle.partitions=108 spark.submit.deployMode=client spark.ui.showConsoleProgress=true

I can access the UI through my browser, however. Any help would be appreciated.