a16z-infra / ai-town

A MIT-licensed, deployable starter kit for building and customizing your own version of AI town - a virtual town where AI characters live, chat and socialize.
https://convex.dev/ai-town
MIT License
7.12k stars 651 forks source link

Adding a stopWords parameter in the LLM config. #235

Closed Viswa4599 closed 1 month ago

Viswa4599 commented 1 month ago

Some cloud models break without the '<|eot-id|>' stop word. So added an optional stopWords param in the LLM_CONFIG that is then added to the parameters

Viswa4599 commented 1 month ago