-
We need to add Qubole JDBC driver config.
The only problem is to test it.
-
Currently user can run Qubole.configure as many times as possible. It modifies auth_token, url, api_version etc. But these changes not reflected in the connection agent, because it is cached once and …
-
Imagine file1 in the local disk already partially(or completely cached)
ls -lrt File1*
-rw-rw-rw- 1 yarn yarn 13631488 Feb 8 20:03 File1
-rw-r--r-- 1 yarn yarn 12 Feb 8 20:03 File1_mdfile
``…
-
The Kinesis connector seems to have very limited usage from looking at slack conversations and vendor data.
The current connector codebase uses a old, deprecated SDK for Kinesis that is now in mainte…
-
I'm receiving this error running sparklens on spark history file
```
Failed in Analyzer StageSkewAnalyzer
java.lang.ArithmeticException: / by zero
at com.qubole.sparklens.analyzer.StageSke…
-
Setup:
Rubix Version : 0.3.1
Presto : 0.172
Emr AMI: 4.9.3
I've installed rubix into presto by using a custom build of presto and overriding the configuration in [presto's HdfsConfigurationUpdat…
-
ToDos
- display for spark dataframe : [qubole](https://docs.qubole.com/en/latest/user-guide/notebooks-and-dashboards/notebooks/jupyter-notebooks/data-visualization-jupy/plot-spark-dataframe.html) …
-
Today interruptions are thrown as RuntimeException which bubbles up as warning logs. Most of the times these interrupts are expected and not needed to be logged e.g. user cancel a query or LIMIT opera…
-
I am trying to run sparklens on event logs of my application.
I am using following command
```
./bin/spark-submit \
--packages qubole:sparklens:0.2.0-s_2.11 \
--master local[0] \
--class…
-
Hi guys, we use spark to read from/ write to Hive Acid tables. We have been using spark-acid for both read and writes. And we started seeing the below error during read on some of the partitions.
`…