search

keldenl / gpt-llama.cpp

A llama.cpp drop-in replacement for OpenAI's GPT endpoints, allowing GPT-powered apps to run off local llama.cpp models instead of OpenAI.
MIT License
594 stars 67 forks source link

gguf supported? #61

Open hiqsociety opened 1 year ago

hiqsociety commented 1 year ago

gguf supported?

Marc2629 commented 1 year ago

I thought not but I edited the test shell file in the scripts to accept gguf too and it worked. This;

# Check if the file exists
if [[ "$path" != *.bin && "$path" != *.gguf ]]; then
    echo "Error: The file does not exist. Please make sure you have provided the correct path."
    exit 1
fi

# Check if the file has a .bin extension
if [[ "$path" != *.bin && "$path" != *.gguf ]]; then
    echo "Error: The file extension is not .bin. Please make sure you have provided the correct file."
    exit 1
fi