namin / llm-verified-with-monte-carlo-tree-search

LLM verified with Monte Carlo Tree Search
https://arxiv.org/abs/2402.08147
MIT License
210 stars 25 forks source link

Crl/whole sampling #40

Closed ChloeL19 closed 4 months ago

ChloeL19 commented 4 months ago

Implemented the following scripts: run_clover_whole.py --> evaluates modes on the clover dataset using pass@10 (not VMCTS), using logic from previously implemented run_whole.py