-
## Description
supporting [substrait plans](https://substrait.io/) opens up a lot of possibilities of easily integrating with external tools (such as polars).
-
### What is the problem the feature request solves?
Spark has specific handling of overflows when ANSI mode is enabled and we need to add the same in Comet.
### Describe the potential solution
_No …
-
Arrow Flight protocol would be nice both as a datasource and as an API for downstream clients.
Some useful links:
https://github.com/apache/arrow-rs/issues/1413
https://arrow.apache.org/blog/2019…
-
### Background
assume we have
```
table/year=2022/month=03/day=20/log.parquet
table/year=2022/month=03/day=21/log.parquet
```
consider the query
```
select count(1) from table where year = '…
-
The desired use case is data scientists or other users working with arrow-based data, such as parquet, pandas, polars, etc, and who would like to get that data into or out of Trino, without having to …
-
**Is your feature request related to a problem or challenge? Please describe what you are trying to do.**
Stems from https://github.com/apache/arrow-datafusion/issues/7342
**Describe the sol…
-
The `extract` function pulls out a part of a timestamp. In particular this issue is about these components:
```
* MILLISECOND Return number of milliseconds since the last full second.
…
-
if this pr is merged, we can rewrite `nvl/ifnull` function to `nvl2`, like:
`nvl(expr1, expr2)` -> `nvl2(expr1, expr1, expr2)`
🤔
_Originally posted by @guojidan in https://github.…
-
**Is your feature request related to a problem or challenge? Please describe what you are trying to do.**
In DataFusion, a common operation is to repartition a RecordBatch by hashing one or more …
-
@devinjdangelo says
I looked into the example and the physical plan substrait producer/consumer code. Unfortunately for physical plans, the subtrait consumer and producer are only implemented for …
alamb updated
3 months ago