world-federation-of-advertisers / cardinality_estimation_evaluation_framework

Evaluation framework and methods for estimating cardinalities of groups of sets
Apache License 2.0
22 stars 9 forks source link

Add stratified sketch based on exp-ADBF. #84

Closed huangxichen1 closed 4 years ago

huangxichen1 commented 4 years ago

Note: the current smoke test eval for the stratified ADBF will return error messages. We are investigating the issue.

Example run with the following command line script:

K_OUTPUT_DIR_FREQ="tmp_output_directory"
K_NUM_RUNS=10

python3 src/evaluations/run_evaluation.py \
--evaluation_out_dir="$K_OUTPUT_DIR_FREQ" \
--analysis_out_dir="$K_OUTPUT_DIR_FREQ" \
--report_out_dir="$K_OUTPUT_DIR_FREQ" \
--evaluation_config="frequency_smoke_test" \
--sketch_estimator_configs="stratified_sketch_exp_adbf-100000_10-first_moment_estimator_exp_expectation-no_local_dp-no_global_dp-5" \
--evaluation_run_name="simple_run" \
--analysis_type="frequency" \
--num_workers=0 \
--num_runs=$K_NUM_RUNS \
--max_frequency=5 \
--error_margin="0.1,0.1" \
--proportion_of_runs="0.9,0.95" \
--run_evaluation=True \
--run_analysis=True \
--generate_html_report=False