Prevents errors due to exceeding bedrock max_tokens.
Most Bedrock models have an upper limit of 4096 for max_tokens, but a few classes attempt to pass higher values, e.g., in FormativeMemoryFactory, Reflection, and WorldBackgroundAndRelevance, resulting in errors.
Prevents errors due to exceeding bedrock max_tokens.
Most Bedrock models have an upper limit of 4096 for max_tokens, but a few classes attempt to pass higher values, e.g., in
FormativeMemoryFactory
,Reflection
, andWorldBackgroundAndRelevance
, resulting in errors.