write fails on large dataframes

JuliaData / Avro.jl

Pure Julia implementation for reading/writing data in the Avro format

MIT License

16 stars 6 forks source link

write fails on large dataframes #18

Open 0xYUANTI opened 2 years ago

0xYUANTI commented 2 years ago

hi :)

as indicated in the Tables.jl docs, for large dataframes (>10k columns), Tables.Schema stores its values in .storenames and .storedtypes instead of the type parameters. This causes e.g. Avro.writetable to crash because names/types is nothing.