-
### Description
Spark supports `Generate` with an option outer to always include input even the unnested array/map is null or empty:
e.g.
```sql
-- without outer
spark-sql> select 1 as a, b f…
-
I am trying to run the tutorial on [this](https://github.com/Esri/gis-tools-for-hadoop/wiki/Aggregating-CSV-Data-(Spatial-Binning)) page.
However, this instruction throws an error:
`FROM (SELECT S…
-
Hi folks
I am launching a new cluster using Google's dataproc and although using bigQuerySelect works and return results when I try to save those results to a big query table it fails with the below …
-
# Links/Resources:
- Slides: https://www.slideshare.net/databricks/presto-on-apache-spark-a-tale-of-two-computation-engines
- Spark Summit Talk: https://www.youtube.com/watch?v=obLnTw_pyDw
- Det…
-
### Backend
VL (Velox)
### Bug description
[Expected to run with JDK 8 and Ubuntu OS for gluten 0.5.0 here is the spark config used for same
`conf = {
"spark.plugins":"io.glutenproject.Gl…
-
Sorry for asking this here. Does splout DB support joins? Intended use case is joining large batch-generated table with a small dimension table on the fly.
-
Using sparklyr version 0.2.29, and sparkapi 0.3.18
On an AWS EM cluster, running the following to connect fails:
```
Sys.setenv(SPARK_HOME="/usr/lib/spark")
sc /etc/spark/conf
drwxr-xr-x 3 root roo…
-
### Code of Conduct
- [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)
### Search before asking
- [X] I have searched in the [issues](http…
-
Hi Team,
our hudi jobs are failing with below exception.
Can you please help me on this.
HoodieException: Commit 20220509105215 failed and rolled-back !
at org.apache.hudi.utilities.deltastreame…
-
If we decide to do another version of the course, here are some new topics that could be exciting to add. This is off the top of my head, feel free to suggest other topics.
Bias / fairness
* Detec…