google-deepmind / concordia

A library for generative social simulation
Apache License 2.0
633 stars 148 forks source link

Add Bedrock MODEL_MAX_OUTPUT_TOKENS_LIMITS #73

Closed austinmw closed 3 months ago

austinmw commented 3 months ago

Prevents errors due to exceeding bedrock max_tokens.

Most Bedrock models have an upper limit of 4096 for max_tokens, but a few classes attempt to pass higher values, e.g., in FormativeMemoryFactory, Reflection, and WorldBackgroundAndRelevance, resulting in errors.