Closed filopedraz closed 1 year ago
v1
manifest.json
{ "weightsDirectoryUrl": "https://huggingface.co/TheBloke/Mistral-7B-Instruct-v0.1-GGUF/resolve/main/", "weightsFiles" : ["mistral-7b-instruct-v0.1.Q5_0.gguf"], "binariesUrl": { "aarch64-apple-darwin": "https://github.com/premAI-io/prem-services/releases/download/v1/cht-llama-cpp-mistral-1-aarch64-apple-darwin" }, "serveCommand": "./cht-llama-cpp-mistral-1-aarch64-apple-darwin --model_path=mistral-7b-instruct-v0.1.Q5_0.gguf" }, { "weightsDirectoryUrl": "https://huggingface.co/TheBloke/Mistral-7B-OpenOrca-GGUF/resolve/main/", "weightsFiles" : ["mistral-7b-openorca.Q5_K_S.gguf"], "binariesUrl": { "aarch64-apple-darwin": "https://github.com/premAI-io/prem-services/releases/download/v1/cht-llama-cpp-mistral-1-aarch64-apple-darwin" }, "serveCommand": "./cht-llama-cpp-mistral-1-aarch64-apple-darwin --model_path=mistral-7b-openorca.Q5_K_S.gguf" }
v1
GH release (in future PRs, just force-pushv1
tag)manifest.json
with this spec https://github.com/premAI-io/prem-registry/pull/87: