Implementation Of StreamingLens Without Changing in Existing Code.

[rpatid10]

Hi, I am Trying to Implement sparklens for streaming Application. I am able to do the same for spark Batch Application by adding below additional line in my batch application spark submit command.

--jars /home/sparklens-0.1.2-s_2.11.jar --conf spark.extraListeners=com.qubole.sparklens.QuboleJobListener --conf spark.sparklens.reporting.disabled=true

Without Changing anything in code.

now I am trying to do the same with my streaming Applications also and using --jars /path/to/spark-streaminglens_2.11-0.5.3.jar this jar in spark-submit command. Can someone kindly suggest if is there any way to run the same without changing anything in code.

//all Imports

object StreamApp {

def main(args: Array[String]): Unit = {

//SparkSession With sparklens Properties val spark = SparkSession .builder() .appName("SparkLence_With_Spark_Submit") .getOrCreate()

  // code for streaming Application

  }
  }

[rpatid10]

Closing as Added https://github.com/qubole/sparklens/issues/74 with More details here.