search

cjdoris / ARFFFiles.jl

Load and save ARFF files
MIT License
5 stars 2 forks source link

Comparison with Parquet.jl? #10

Closed tlienart closed 3 years ago

tlienart commented 3 years ago

Hello! thanks for this package, I'm not very familiar with ARFF files and was wondering whether it's a similar idea than Parquet files (for which there's a package) ? (i.e. columnar stuff with an indication of the eltype of each column)?

Are the two effectively equivalent in terms of how much information they contain? if so are you aware of advantages for one or the other?

Thanks!

cjdoris commented 3 years ago

Use Parquet, it's a much more widespread format, supports more data types and uses a more compact binary representation so is faster to read.

I only wrote this package because some data I needed was only available in ARFF, but I wouldn't recommend writing your data in this format.