add wandb for run_whole and fix a few things with token_counter

namin / llm-verified-with-monte-carlo-tree-search

LLM verified with Monte Carlo Tree Search

https://arxiv.org/abs/2402.08147

MIT License

210 stars 25 forks source link

add wandb for run_whole and fix a few things with token_counter #46

Closed davidbrandfonbrener closed 3 months ago

davidbrandfonbrener commented 3 months ago

This mainly adds wandb for run_whole.py

As a result I also changed how logging was working for that file, although I tried to print similar outputs.

I also needed to fix the way that token_counter was handling generate_full and generally changed it so that the counter is always kept up to date even if the run is not capping the number of tokens.