Closed rmusser01 closed 5 months ago
title.
https://github.com/ggerganov/llama.cpp/blob/master/examples/server/README.md
Done.
Now need to confirm the user can: [ ] Select local model to be loaded via path [ ] Pass in Huggingface URL along with the model specification and have it work
It works.
title.
https://github.com/ggerganov/llama.cpp/blob/master/examples/server/README.md