Question: where is the max support length defined?

[njbrake]

Hi,

From looking through the docs (https://ucbepic.github.io/docetl/concepts/operators/#input-and-output) there is the statement

What happens if the input is too long?

When the input data exceeds the token limit of the LLM...

Where is that max input length defined? I did a quick browse around the docs and couldn't find a clear answer.

Thanks!

[shreyashankar]

Good question! The function to truncate message content is here. It's called before every litellm completion call; e.g., here

[njbrake]

Thanks!