Snowflake returns BigDecimal natively (from backend to driver)
To preserve BigDecimal values within Arrow batches, set the enableHigherPrecision value to true in the context using `WithHigherPrecision“.
Benefits
This offers two main benefits: it helps avoid precision loss and defers the conversion to upstream services.
Alternatively, without this setting, all non-zero scale numbers will be converted to float64, potentially resulting in loss of precision.
Checklist
[x] Created tests which fail without the change (if possible)
[x] Extended the README / documentation, if necessary
Description
enableHigherPrecision in Arrow batches
Snowflake returns BigDecimal natively (from backend to driver) To preserve BigDecimal values within Arrow batches, set the
enableHigherPrecisionvalue to true in the context using `WithHigherPrecision“.Benefits
This offers two main benefits: it helps avoid precision loss and defers the conversion to upstream services. Alternatively, without this setting, all non-zero scale numbers will be converted to float64, potentially resulting in loss of precision.
Checklist