-
Hi,
First of all, amazing project!
From the report generated from http://sparklens.qubole.com/ , I see the ideal executor plot where it plot "the minimal number of executors (ideal) which could …
-
I would like to check a command's status programmatically. However the result of
> presto$check(commandId)
is printed to console and I couldn't assign it to a variable. I've tried capture.outpu…
-
Hi,
Are there any plans to adjust Sparklens for streaming processing? I assume that right now it is suitable only for batch processes?
Best,
Dominika
-
Hi,
I tried specifying an S3 location as spark.sparklens.data.dir and I am getting the following error.
The issue is reproduced in every job.
As per my understanding, this is the code which is du…
-
We are using databricks Spark to load data into snowflake. It is working perfectly with Batch jobs but failing with streaming. here is code:
```scala
val options =Map(
"sfUrl" -> "********.snowf…
-
For some AWS instances with low network bandwidth, we are seeing IO bottle necks for users.
Multiple users are requesting a light weight node level cache with async prefetch to improve query latency…
-
Is there any reference code snipped on how to get jsonFile , while using Sparklens in the notebook env
ghost updated
4 years ago
-
[EventHistoryToSparklensJson class](https://github.com/qubole/sparklens/blob/master/src/main/scala/com/qubole/sparklens/app/EventHistoryToSparklensJson.scala#L20-L37) treats input events file argument…
-
When I upload the sparklens report json file to [sparklens](http://sparklens.qubole.com/), I don't get any reports delivered. I have even checked my spam folders.
-
As per instructions, I was trying to copy the file and errors out.
aws s3 cp s3://public-qubole/lambda/spark-2.1.0-bin-spark-lambda-2.1.0.tgz s3://myBucket-xxx/spark-on-lambda/spark-2.1.0-bin-spark…