Closed sgsdxzy closed 3 weeks ago
Support sharded .gguf files in a directory. Also the user can supply the config.json and tokenizer in the directory.
.gguf
config.json
Support sharded
.gguffiles in a directory. Also the user can supply theconfig.jsonand tokenizer in the directory.