Open scottsun94 opened 10 months ago
https://github.com/ray-project/ray-llm/tree/master/models#engine-config
Couldn't find "max_total_tokens" in the doc
https://github.com/ray-project/ray-llm/tree/master/models#engine-config
Couldn't find "max_total_tokens" in the doc