-
Goal is to replace the SQLite database with parquet files that are shared between R and Python scripts, so that we have interoperability of data and remove redundancy.
To achieve this goal we need…
-
https://github.com/brad-richardson/osm-pbf-parquet
Pros:
* **much** faster
* produces Parquet
* fixes (or will fix) schema warts like Decimal → double
* partitioned by type (by default)
* no…
-
### What happens?
when using the IN / OR operator against a file parquet,
all the other filters that can be push-down filtered onto the parquet file are discarded.
This is very limiting in case…
-
### Describe the bug, including details regarding any error messages, version, and platform.
platform: Ubuntu 22.04, x86_64
arrow: release-17.0.0-rc2
According to the
https://github.com/apach…
-
Need to check this in case there was an error in conversion.
-
Taking the first file from here (https://noaa-goes17.s3.amazonaws.com/index.html#ABI-L1b-RadF/2022/001/00/) as an example:
The following code:
```python
import kerchunk.hdf
import json
…
-
### Describe the bug
```
❯ [[a]; [null]] | polars into-df
# a
0
❯ [[a]; [null]] | polars into-df | polars to-parquet test.parquet
thread 'polars-0' panicked at /home/runner/.cargo/regist…
-
### Describe the bug, including details regarding any error messages, version, and platform.
Attempting to build Arrow 16.0.0 (cpp) with -DARROW_PARQUET=ON on illumos (Solaris derivative) fails wit…
-
### Is your feature request related to a problem?
_No response_
### Describe the solution you'd like
I know pairing read_ and to_ functions follows Pandas' style but I think read_ and write_ makes …
-
_This issue was auto-generated_
PR: https://github.com/deephaven/deephaven-core/pull/5914
Author: malhotrashivam
## Original PR Body
Added a new `OutputStream` to write to S3 and moved all parquet …