-
I am representing one of large Microsoft clients. We run a lot of processes on Azure Databricks and Azure SQL database. The project that I work on uses Spark 3.5 and Azure SQL. We export the data from…
-
### Topic
Support new SQL
### Description
您好,我们最近项目中用到了dt-sql-parser这个插件,感觉内容挺丰富的,但是我们想知道一些默认的不同引擎下的sql 语法校验规则,从哪里能找到呢
grammar/spark
/SparkSqlParser.g4和https://github.com/DTStack/dt-sql-parser/bl…
-
### Describe the bug
When trying to use `{{ source() }}` from a non-iceberg table, a `dbt-glue` project set up for the iceberg datalake format will refuse to read the source because it's not an icebe…
-
### Code of Conduct
- [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)
### Search before asking
- [X] I have searched in the [issues](http…
-
### Describe the bug
We've seen this exception when running queries with `spark.comet.exec.shuffle.mode=native`:
```
Py4JJavaError: An error occurred while calling o456.collectToPython.
: org.ap…
-
## Context
I have a table in BigQuery with columns of the data type [RANGE](https://cloud.google.com/bigquery/docs/reference/standard-sql/data-types#range_type). When I attempt to read the table wit…
-
### Apache Iceberg version
1.5.0
### Query engine
Spark
### Please describe the bug 🐞
When using time travel to retrieve a previous version of a table via a snapshot ID, the table’s schema is use…
-
### Version
main branch
### Describe what's wrong
I want to use federation query using hive metastore stored in 2 hadoop clusters.
So we added two hive catalogues to metalake.
There is a diff…
-
### Description
Connecting to a Spark SQL endpoint is very slow - 67 seconds
[dbeaver-diagnostic-info-1725054025842.zip](https://github.com/user-attachments/files/16822226/dbeaver-diagnostic-info-17…
-
I am unable to add cdc records to a snapshot.
environment
```
emr 7.2.0
AmazonCloudWatchAgent 1.300032.2,
Hive 3.1.3,
Spark 3.5.1,
Zeppelin 0.10.1
```
spark command
```
spark-shell …