-
**Is your feature request related to a problem? Please describe.**
Recently, we've added Spark SQL support to SqlRender and a few OHDSI tools. We'd like to do the same for WhiteRabbit.
**Describe …
-
We need to make it easier for 3rd party driver authors to run a subset of tests.
There are a few different rough edges that add up to a frustrating experience.
#### 3rd party authors are unable …
-
### Description
As Gluten currently can't fully cover spark functions, we will have to fallback some operators to Vanilla Spark, which leads an conflict of offheap and onheap memory conflict. Current…
-
Long Running Spark as a SparkSQL query Service or ETL ad-hoc Service is very common nowadays, the key-point is **"Shared Session accross jobs" as Spark JobServer or Kyuubi introduced**, NO spark sumi…
crabo updated
2 years ago
-
Adding a recursive field to a proto breaks things, see https://github.com/drewrobb/sparksql-scalapb-test/commit/4cfc436c5a3a9f75d4218a0695ff7e9c2b8300e3 for a reproduction. I'm happy to help address t…
-
Hi, I got an exception when the data was saved to clickhouse by sparkSQL with clickhouse-jdbc.
This would happen, when the type of the columns was Array[Int64].
And the SparkSql will handle the ar…
-
### Search before asking
- [X] I searched the [issues](https://github.com/sqlfluff/sqlfluff/issues) and found no similar issues.
### What Happened
The following query is passed with 2.0.3 but fail…
-
This is related to #84 and is a super set of it.
Spark is a bit of a hot mess with support for floating point `-0.0`
Most SQL implementations normalize `-0.0` to `0.0`. Spark does this for the …
-
We are using SparkContext throughout loaders and example pipelines. It makes sense to move these to using SparkSession given that we're relying on Spark 2.0.
-
Spark 3.1
sparksql-scalapb_2.12:0.11.0
When used as a dataset, scalapb generated case classes don't catch type mismatches in the logical plan like ordinary scala case classes do.
E.g. in spark…