search

qubole / streaminglens

Qubole Streaminglens tool for tuning Spark Structured Streaming Pipelines
http://www.qubole.com
Apache License 2.0
17 stars 5 forks source link

streaminglens didnot print recommendation? #3

Open ghost opened 2 years ago

ghost commented 2 years ago

i have written below code to my spark structured streaming program, but i doesnot print recommendation in driver log, why?

`var options: Map[String, String] = Map();

  options += ("streamingLens.expectedMicroBatchSLAMillis" -> "30000");

    options += ("streamingLens.reporter.intervalMinutes" -> "2");

    val streamingLens = new StreamingLens(spark, options);`