TsinghuaDatabaseGroup / DB-GPT

An LLM Based Diagnosis System (https://arxiv.org/pdf/2312.01454.pdf)
http://dbgpt.dbmind.cn/
Apache License 2.0
464 stars 64 forks source link

Clarification on UCT(v) Implementation in Tree Search Algorithm #98

Closed andyyosshi closed 1 month ago

andyyosshi commented 4 months ago

I found the concept of utilizing the UCT score intriguing. Specifically, I am curious about how the UCT(v) function is implemented in the actual code base.

In the paper, you describe the function as UCT(v) = w(v)/n(v) + C・√ln(N)/n(v), and I am trying to locate the exact part of the code that reflects this formula. Could you confirm if the logic around line 326 in /multiagents/reasoning_algorithms/tree_of_thought/UCT_vote_function.py is where this UCT computation takes place?

If not, could you please guide me to the right section in the code? Understanding the practical application of UCT(v) will greatly assist me in comprehending the overall tree search strategy you have proposed.

Thank you for your time and assistance.

zhouxh19 commented 4 months ago

yes, but current logic is somewhat strange. We are developing a new version where each module is better decoupled. This will facilitate easier modifications to the searching algorithm. Stay tuned for updates :-)