search

ray-project / ray-llm

RayLLM - LLMs on Ray
https://aviary.anyscale.com
Apache License 2.0
1.22k stars 87 forks source link

[Docs] "max_total_tokens" is missing in the doc #75

Open scottsun94 opened 10 months ago

scottsun94 commented 10 months ago

https://github.com/ray-project/ray-llm/tree/master/models#engine-config

Couldn't find "max_total_tokens" in the doc

Screenshot 2023-10-16 at 4 20 57 PM