Convert arrow types to those compatible with Vega when data_encoding_format is set

vega / vegafusion

Serverside scaling for Vega and Altair visualizations

https://vegafusion.io

BSD 3-Clause "New" or "Revised" License

317 stars 17 forks source link

Convert arrow types to those compatible with Vega when data_encoding_format is set #404

Closed jonmmease closed 11 months ago

jonmmease commented 12 months ago

The apache-arrow JavaScript library will extract Int64 values as bigint, which aren't compatible with Vega. This PR casts all numeric types to Float64 when data_encoding_format is set.

Even with the type conversion from integer to float, there are some issues with using Arrow tables directly in the Vega JavaScript library. See https://github.com/vega/vl-convert/pull/119. So I'm not sure I want to move forward with this PR right now.