search

fgenie / rims_minimal

Been lazy enough to pull over again to the end!
0 stars 1 forks source link

run baseline #50

Closed strutive07 closed 2 weeks ago

strutive07 commented 2 weeks ago

How to run?

OPENAI_API_BASE=http://localhost:8000/v1 python run_baseline.py --gsm_jslf=some_dir/gsm8K_test.jsonl --dataset_type=gsm --backbone=Meta-Llama-3-8B-Instruct

retry error row only

OPENAI_API_BASE=http://localhost:8000/v1 python run_baseline.py --gsm_jslf=/data/recoteam_583/joel/opensource/rims_minimal/dataset/gsm8K_test.jsonl --dataset_type=gsm --backbone=Meta-Llama-3-8B-Instruct --retry_error_in_result_file_path=outputs/gsm8K_test_dt.gsm/Meta-Llama-3-8B-Instruct/n1_baseline_raw_query_result.jsonl