-
## What this project could be
I think this project needs someone who wants to make a world class python dataframe library and user experience take the helm. I will argue why I think this is a comp…
alamb updated
1 month ago
-
**Describe the bug**
ORDER BY is ignored when COPYing from a pyarrow table to a csv file
This happens both for tables created with `pyarrow.Table.from_pydict` and from ORC files.
**To Reproduce…
-
### Is your feature request related to a problem or challenge?
ScalarValue does not currently support Maps, see e.g. https://github.com/apache/datafusion/issues/8262#issuecomment-1852700799.
http…
-
### Is your feature request related to a problem or challenge?
I noticed below code:
https://github.com/apache/datafusion/blob/6a4a280e3cf70fe5f1a1cfe7c2de13e4c39f89bb/datafusion/physical-expr/src/e…
-
### Is your feature request related to a problem or challenge?
In `unparser/expr.rs`, list scalar values haven't been supported yet.
```rust
ScalarValue::FixedSizeList(_a) => not_impl_err!("Unsuppo…
-
I've been starting to experiment with implementing the Open Variant Type [^1] in Rust / DataFusion. There is a specification and Java library for this, and Spark will release this type in 4.0. There a…
-
### Code
DataFusion issue with complete details: https://github.com/apache/arrow-datafusion/issues/8696
[arrow-datafusion](https://github.com/apache/arrow-datafusion) runs `cargo test` on Wi…
-
Thanks for putting this together, this is a great improvement on the state of JSON handling in datafusion! I've been trying this out in Arroyo (https://github.com/ArroyoSystems/arroyo/pull/640), and i…
-
### What is the problem the feature request solves?
Comet is currently slower than Spark for query 19.
Some initial observations:
- The sort merge join cannot run natively due to https://gith…
-
### Is your feature request related to a problem or challenge?
I'm trying to collect known issues related to error handling in datafusion.
So far I can see different categories which can be impr…