facebookincubator / velox

A composable and fully extensible C++ execution engine library for data management systems.
https://velox-lib.io/
Apache License 2.0
3.51k stars 1.15k forks source link

Create microbenchmarks for Iceberg read in Velox #8754

Closed yingsu00 closed 4 months ago

yingsu00 commented 9 months ago

Description

Add a new IcebergSplitReaderBenchmark.cpp to benchmark the performance of the IcebergSplitReader.

We will need to generate randomized data and delete files. The references include

  1. the IcebergReadTest.cpp, in which we show how to generate data and delete files;
  2. ParquetReaderBenchmark.cpp, in which we show how to write a microbenchmark
yingsu00 commented 9 months ago

cc @agrawalreetika