search

voltrondata-labs / arrowbench

R package for benchmarking
Other
13 stars 9 forks source link

Allow one to change the compression of files for TPC-H #71

Closed jonkeane closed 2 years ago

jonkeane commented 2 years ago

This adds a passing of the compression argument to get_input_func() so it's easier to test different compressions when using the pattern:

library(arrowbench)
library(dplyr, warn.conflicts = FALSE)
library(arrow, warn.conflicts = FALSE)

input_funcs <- get_input_func(
        engine = "arrow",
        scale_factor = 0.01,
        query_id = 1,
        format = "parquet"
      )

get_query_func(1, "arrow")(input_funcs)