It is very convenient to have support for system prompts even when using function calling. In the current implementation, I couldn't find an easy way to supply a custom system prompt. Hence, I added a parameter for system_prompt on ToolUser, which simply inserts the user-specified system prompt in front of the system prompt generated for function calling. This produces a longer system prompt, but this did not negatively affect the function calling effectiveness of Claude 3 Opus during my personal testing.
For debugging purposes, I also added a verbosity flag that makes it easier to track the final system prompt.
What it does and Why
It is very convenient to have support for system prompts even when using function calling. In the current implementation, I couldn't find an easy way to supply a custom system prompt. Hence, I added a parameter for system_prompt on ToolUser, which simply inserts the user-specified system prompt in front of the system prompt generated for function calling. This produces a longer system prompt, but this did not negatively affect the function calling effectiveness of Claude 3 Opus during my personal testing.
For debugging purposes, I also added a verbosity flag that makes it easier to track the final system prompt.