Pass false for special tokens to be compatible with llama.cpp commit 40f74e4

eastriverlee / LLM.swift

LLM.swift is a simple and readable library that allows you to interact with large language models locally with ease for macOS, iOS, watchOS, tvOS, and visionOS.

MIT License

326 stars 34 forks source link

Pass false for special tokens to be compatible with llama.cpp commit 40f74e4 #21

Closed shawiz closed 4 months ago

shawiz commented 4 months ago

Since commit 40f74e4 from llama.cpp, this library is broken due to changed in API. This commit addresses the issue with passing "false" to show special tokens in the output.

eastriverlee commented 4 months ago

Thank you for letting me know and for contributing! I haven't been checking this repo lately, because I was doing some other project. Wouldn't have known this problem if you hadn't told me.

shawiz commented 4 months ago

You're welcome! Thank you for building such an awesome library :)