Open sslivkoff opened 1 year ago
Polars now has a native "Binary" type. It seems that it would be a better fit, as well as more performant to just pass it in to the Binary type
The same happens with the redshift "super" type where usually json data is put into and at the moment gives an error of type not implemented.
The problem
When loading postgres JSONB columns to polars, connectorx currently throws
Related: #121
The solution
For sqlite tables with JSON columns, connectorx simply loads these columns as
str
s without parsing them into JSON. This is nice fallback and it would be nice to have this fallback for postgresql as well instead of throwing an error.This would be very helpful in situations where you are trying to load some set of rows that happen to have JSON columns. It would prevent the query from breaking and you could still decode the JSON text in the app if you need it.
Minimal example to reproduce