search

eastriverlee / LLM.swift

LLM.swift is a simple and readable library that allows you to interact with large language models locally with ease for macOS, iOS, watchOS, tvOS, and visionOS.
MIT License
326 stars 34 forks source link

`endTokens` doesn't always represent `encode(endString)` #2

Closed eastriverlee closed 9 months ago

eastriverlee commented 9 months ago

instead of endTokens program should check endString directly. this can cause a generation loop.