apache / arrow-julia

Official Julia implementation of Apache Arrow
https://arrow.apache.org/julia/
Other
284 stars 59 forks source link

Failure to read valid file #511

Open adienes opened 3 months ago

adienes commented 3 months ago

both pyarrow and polars can read this table, but mwe.arrow.zip

julia> Arrow.Table("mwe.arrow")

1-element ExceptionStack:
TaskFailedException

    nested task error: MethodError: no method matching init(::Nothing, ::Vector{UInt8}, ::Int64)

    Closest candidates are:
      init(::Type{T}, ::Vector{UInt8}, ::Integer) where T<:Union{Arrow.FlatBuffers.Struct, Arrow.FlatBuffers.Table}
       @ Arrow ~/.julia/packages/Arrow/5pHqZ/src/FlatBuffers/table.jl:43

    Stacktrace:
     [1] getproperty(x::Arrow.Flatbuf.Field, field::Symbol)
       @ Arrow.Flatbuf ~/.julia/packages/Arrow/5pHqZ/src/metadata/Schema.jl:542
     [2] build(field::Arrow.Flatbuf.Field, batch::Arrow.Batch, rb::Arrow.Flatbuf.RecordBatch, de::Dict{Int64, Arrow.DictEncoding}, nodeidx::Int64, bufferidx::Int64, convert::Bool)
       @ Arrow ~/.julia/packages/Arrow/5pHqZ/src/table.jl:668
     [3] iterate(x::Arrow.VectorIterator, ::Tuple{Int64, Int64, Int64})
       @ Arrow ~/.julia/packages/Arrow/5pHqZ/src/table.jl:629
     [4] copyto!(dest::Vector{Any}, src::Arrow.VectorIterator)
       @ Base ./abstractarray.jl:948
     [5] _collect
       @ ./array.jl:765 [inlined]
     [6] collect
       @ ./array.jl:759 [inlined]
     [7] macro expansion
       @ ~/.julia/packages/Arrow/5pHqZ/src/table.jl:526 [inlined]
     [8] (::Arrow.var"#102#108"{Bool, Channel{Any}, ConcurrentUtilities.OrderedSynchronizer, Dict{Int64, Arrow.DictEncoding}, Arrow.Batch, Int64})()
       @ Arrow ~/.julia/packages/ConcurrentUtilities/QOkoO/src/ConcurrentUtilities.jl:48
Stacktrace:
 [1] sync_end(c::Channel{Any})
   @ Base ./task.jl:448
 [2] macro expansion
   @ ./task.jl:480 [inlined]
 [3] Arrow.Table(blobs::Vector{Arrow.ArrowBlob}; convert::Bool)
   @ Arrow ~/.julia/packages/Arrow/5pHqZ/src/table.jl:441
 [4] Table
   @ ~/.julia/packages/Arrow/5pHqZ/src/table.jl:415 [inlined]
 [5] Table
   @ ~/.julia/packages/Arrow/5pHqZ/src/table.jl:407 [inlined]
 [6] Arrow.Table(input::String)
   @ Arrow ~/.julia/packages/Arrow/5pHqZ/src/table.jl:407
 [7] top-level scope
   @ REPL[4]:1