-
### What happens?
This is probably also a problem for other nested types, but my problem is with maps. :)
Using DuckDB to write MAP(VARCHAR, VARCHAR) columns with lots of repeated keys/values t…
-
This is to address https://github.com/hangxie/parquet-tools/issues/446, which seems cannot be resolved by upstream (parquet-go) due to go's limitation.
Since `PARGO_PREFIX_` is hardcoded in parquet…
-
We currently have a flat list of poorly named files, and we plan to add more files to each directory.
For top-line directories, I am thinking
- data
- mcmc_raw
- mcmc_tidy
- figures
- diagno…
-
### Describe the bug, including details regarding any error messages, version, and platform.
When trying to use `MessageColumnIO` to get a record reader, the following error occurs:
```
Exception i…
-
# 📋 Background
During last reprocessing in November 2024 where we processed CCD images in 2023 Feb-May. A lot of data was disregarded due to "missing platform data". This might be true and nothing …
-
- **Package Name**: azureml.core
- **Package Version**: 1.58.0
- **Operating System**: Linux
- **Python Version**: 3.10.12
**Describe the bug**
When making a data asset reference to the model in ML …
-
### Description
I can currently write parquet files in a hive partition scheme using "write_parquet(file, partition_by=['a', 'b'])".
The partition_by parameter is currently not available for the "s…
-
### What happens?
I receive an error when attempting to create a forgein table to the azure data lake using a service principal for credentials.
This is the error:```Invalid Input Error: Secret pr…
-
Since switching to the new Azure native FS in our environments we've been seeing a lot of connection leaks and java.lang.IllegalStateException: Unbalanced enter/exit exceptions. The native FS seemed t…
-
### Description
Right now, schema evolution (here changing of field type) is not really handled by polars.
```python
import polars as pl
myfile = 'partition_test'
df = pl.DataFrame({'id': [1000…