Closed matthewclegg closed 4 years ago
This is the end-to-end test of the recent changes to support frequency evaluation. To run this test, use the following command line:
python3 src/evaluations/run_evaluation.py \ --evaluation_out_dir="/tmp/evf/output/debug" \ --analysis_out_dir="/tmp/evf/output/debug" \ --report_out_dir="/tmp/evf/output/debug" \ --evaluation_config="frequency_end_to_end_test" \ --sketch_estimator_configs="exact_multi_set-10000-NA-NA" \ --evaluation_run_name="simple_run" \ --analysis_type=frequency \ --num_workers=1 \ --num_runs=3
Please note that many (most) of the changes made to evaluation_configs.py are temporary. When the full smoke test is implemented in two weeks, the end-to-end test will be replaced.
This is the end-to-end test of the recent changes to support frequency evaluation. To run this test, use the following command line:
python3 src/evaluations/run_evaluation.py \ --evaluation_out_dir="/tmp/evf/output/debug" \ --analysis_out_dir="/tmp/evf/output/debug" \ --report_out_dir="/tmp/evf/output/debug" \ --evaluation_config="frequency_end_to_end_test" \ --sketch_estimator_configs="exact_multi_set-10000-NA-NA" \ --evaluation_run_name="simple_run" \ --analysis_type=frequency \ --num_workers=1 \ --num_runs=3
Please note that many (most) of the changes made to evaluation_configs.py are temporary. When the full smoke test is implemented in two weeks, the end-to-end test will be replaced.