eastriverlee / LLM.swift

LLM.swift is a simple and readable library that allows you to interact with large language models locally with ease for macOS, iOS, watchOS, tvOS, and visionOS.
MIT License
382 stars 40 forks source link

missing argument for llama_token_to_piece #26

Closed xy-gao closed 4 months ago

xy-gao commented 4 months ago

llama.cpp main branch llama_token_to_piece function arguments have changed. int32_t llama_token_to_piece(const struct llama_model * model, llama_token token, char * buf, int32_t length, int32_t lstrip, bool special) missing int32_t lstrip argument in current LLM.swift. let actualLength = Int(llama_token_to_piece(self, token, &buffer, Int32(bufferLength), false))