jan-janssen / LangSim

Application of Large Language Models (LLM) for computational materials science - visit jan-janssen.com/LangSim
http://jan-janssen.com/LangSim/
BSD 3-Clause "New" or "Revised" License
52 stars 10 forks source link

Mitigating unreliable docstring though Graphs? #52

Open utkarshp1161 opened 2 months ago

utkarshp1161 commented 2 months ago

Problem Description

As detailed in Challenges of Large Language Models #48, there is challenge in reproducing results with complex workflows.

Explore

Representing tools (functions) as nodes in a graph, with edges indicating the next logical steps in the workflow for the LLM.

Example: Query: Calculate the bulk modulus of Aluminum (Al). Probable Response: The LLM identifies four potential workflows to compute the bulk modulus. By selecting the shortest workflow, it calculates and provides the bulk modulus of Aluminum.

References

Bernadette-Mohr commented 1 month ago

Code to the first paper: https://github.com/metauto-ai/GPTSwarm