namin / llm-verified-with-monte-carlo-tree-search

LLM verified with Monte Carlo Tree Search
https://arxiv.org/abs/2402.08147
MIT License
215 stars 26 forks source link

add run_diversity, return hiddens from llm #20

Closed davidbrandfonbrener closed 7 months ago

davidbrandfonbrener commented 7 months ago

Added run_diversity.py to run search with actions selected to maximize distance from embeddings of previously seen actions.

This required modifying llm.py to add an option to return hiddens when generating (False by default) and montecarlo.py to store the global features in the montecarlo object.

Also fixed a typo I noticed in llm.py where "prompt" was misspelled.

namin commented 7 months ago

Thanks, this looks like a great start. I'll merged it in now, and play with it a bit later.