getzep / graphiti

Build and query dynamic, temporally-aware Knowledge Graphs
https://help.getzep.com/graphiti
Apache License 2.0
1.37k stars 72 forks source link

Override default max tokens for Anthropic and Groq clients #143

Closed danielchalef closed 1 month ago

danielchalef commented 1 month ago

[!IMPORTANT] Override default max tokens for Anthropic and Groq clients, updating __init__ to apply defaults when not provided.

  • Override default max tokens for Anthropic and Groq clients.
  • Set DEFAULT_MAX_TOKENS to 8192 in anthropic_client.py.
  • Set DEFAULT_MAX_TOKENS to 2048 in groq_client.py.
  • Update __init__ in AnthropicClient and GroqClient to apply DEFAULT_MAX_TOKENS when config.max_tokens is not provided.

This description was created by Ellipsis for ebd7d4bc5da6f1a1d7256c741b06bd51a52b4614. It will automatically update as commits are pushed.