search

hobuinc / silvimetric

Apache License 2.0
8 stars 4 forks source link

Add a check for incoming data types lining up with what tiledb expects #90

Open kylemann16 opened 3 months ago

kylemann16 commented 3 months ago

Currently if there is a datatype mismatch, then the data is still inserted into TileDB, but it's effectively junk.

If an Attribute like ReturnNumber is initialized in TileDB as a uint8, but it is ingested into SilviMetric as a float64, then the data is still inserted into TileDB, but with the wrong stride size, and we end up with 8x more values for ReturnNumber than something that isn't messed up.