search

JonahWhaler / llm-agent-toolkit

LLM AgeToolkit provides minimal, modular interfaces for core components in LLM-based applications.
GNU General Public License v3.0
0 stars 0 forks source link

Incorrect number_of_primers #2

Closed JonahWhaler closed 4 days ago

JonahWhaler commented 5 days ago

number_of_primers is the total number of system instruction and context fed to the model.

# number_of_primers = len(msgs) # From here!

if self.tools is not None:

    tools_metadata = []

    for tool in self.tools:
        tools_metadata.append(tool.info)

    msgs.append(
        MessageBlock(role=CreatorRole.SYSTEM.value, content=TOOL_PROMPT)
    )

else:
    tools_metadata = None

number_of_primers = len(msgs) # To here!