search

fstpackage / fst

Lightning Fast Serialization of Data Frames for R
http://www.fstpackage.org/fst/
GNU Affero General Public License v3.0
614 stars 42 forks source link

benchmark against parquet #244

Open waynelapierre opened 4 years ago

waynelapierre commented 4 years ago

Could you add the benchmark of fst against parquet?

MarcusKlik commented 4 years ago

Hi @waynelapierre, thanks for your request!

I was planning to update the benchmarks using a new package synthetic. With that package those benchmarks can be done in a precise and consistent manner for a wide range of systems and synthetic datasets.

Unfortunately, I haven't had time to finish and release it yet. If that takes too long, I will probably update the README with parguet benchmarks in the near future without using the new package...