Multiple experiments pipeline

namin / llm-verified-with-monte-carlo-tree-search

LLM verified with Monte Carlo Tree Search

https://arxiv.org/abs/2402.08147

MIT License

240 stars 27 forks source link

Multiple experiments pipeline #29

Closed sibiraja closed 8 months ago

sibiraja commented 8 months ago

Run multiple trials at once for a specified experiment.

Example usage format: ./log.sh log/bench_dafny_opt0_run_diversity_without_hints.txt python experiments.py --experiment_name "run_diversity.py" --n_trials 10 --mins_timeout 6 --language "Dafny" --problem_name "problem_opt0" --seed 42 --remove_hints True