search

RelationalAI / rai-sdk-csharp

The RelationalAI Software Development Kit (SDK) for C#
Apache License 2.0
0 stars 1 forks source link

Apache arrow exception when reading Float16: An ArrowArray cannot be built for type HalfFloat #30

Open NRHelmi opened 2 years ago

NRHelmi commented 2 years ago

Apache arrow cannot read Float16. A query example that triggers the exception def output = float[16, 12], float[16, 42.5]

Unhandled exception: System.NotSupportedException: An ArrowArray cannot be built for type HalfFloat.
   at Apache.Arrow.ArrowArrayFactory.BuildArray(ArrayData data)
   at Apache.Arrow.Ipc.ArrowReaderImplementation.BuildArrays(Schema schema, ByteBuffer messageBuffer, RecordBatch recordBatchMessage)
   at Apache.Arrow.Ipc.ArrowReaderImplementation.CreateArrowObjectFromMessage(Message message, ByteBuffer bodyByteBuffer, IMemoryOwner`1 memoryOwner)
   at Apache.Arrow.Ipc.ArrowStreamReaderImplementation.<>c__DisplayClass9_0.<ReadRecordBatch>b__0(Memory`1 messageBuff)
   at Apache.Arrow.Ipc.ArrowStreamReaderImplementation.ReadRecordBatch()
   at Apache.Arrow.Ipc.ArrowStreamReaderImplementation.ReadNextRecordBatch()
   at Apache.Arrow.Ipc.ArrowStreamReader.ReadNextRecordBatch()

Seems not to be handled at the library level

billscheidel-rai commented 1 year ago

Note: This issue has been migrated to https://relationalai.atlassian.net/browse/RAI-6854.

This link is only accessible to employees of RelationalAI.