spiraldb / vortex

An extensible, state-of-the-art columnar file format
https://vortex.dev
Apache License 2.0
1.01k stars 28 forks source link

Move DType variants to VTables #1504

Open gatesn opened 3 days ago

gatesn commented 3 days ago

Currently they're traits implemented by the array, but this provides no validation that the array is actually the correct dtype.

By making them vtables, traits implemented by the encoding, we can then ensure the correct dtype when we downcast and array or ArrayData into the variant trait.