-
### What is the problem the feature request solves?
### What is the problem the feature request solves?
We currently delegate to DataFusion when casting from string to decimal and there are some d…
-
The Arrow project recently created a [new protocol for sharing Arrow data in Python](https://arrow.apache.org/docs/format/CDataInterface/PyCapsuleInterface.html). One of the goals of the protocol is a…
-
### Is your feature request related to a problem or challenge?
We're working on running some used-to-be-Spark pipelines through DataFusion. One case we've noticed where DataFusion doesn't support som…
-
Spark adds a lot of try_* functions in the recent two years, which always return NULL instead of runtime errors. The list is as follows:
- [ ] try_add
- [ ] try_divide
- [ ] try_subtract
- [ ] try…
-
### Describe the bug
We have been using two parquet writers: ArrowWriter vs ParquetSink (parallelized writes). We discovered a bug where the ArrowWriter [includes the arrow schema (by default) in the…
-
# TLDR
* Keep `datafusion-cli` in the apache/datafusion repo
* Make a new repo with a new CLI called `dfdb` (or `datafusion-cli++`or `dfcli`) which is purposely designed for running queries against …
-
### Is your feature request related to a problem or challenge?
For many of the same reasons as listed on https://github.com/apache/arrow-datafusion/issues/8045, having two types of aggregate functi…
alamb updated
2 months ago
-
### Is your feature request related to a problem or challenge?
We are working to add complete `StringView` support in DataFusion, which permits potentially much faster processing of string data. …
-
I've been starting to experiment with implementing the Open Variant Type [^1] in Rust / DataFusion. There is a specification and Java library for this, and Spark will release this type in 4.0. There a…
-
`APPROX_PERCENTILE` is supported in Presto, SingleStore, Redis, Snowflake, Vertica, Databricks, TiDB ........
It is supposed to run much faster than its exact equivalents, i.e. `PERCENTILE_CONT` and …
lmatz updated
1 month ago