how to run .safetensors files?

eastriverlee / LLM.swift

LLM.swift is a simple and readable library that allows you to interact with large language models locally with ease for macOS, iOS, watchOS, tvOS, and visionOS.

MIT License

382 stars 40 forks source link

how to run .safetensors files? #25

Closed davidvct closed 3 weeks ago

davidvct commented 4 months ago

Hi, how to run the model if it is in .safetensors format and splitted into multiple files?

eastriverlee commented 3 weeks ago

this library is for gguf. maybe it can run other formats that are supported by llama.cpp, but made for and tested for gguf extension files only.