search

kaust-generative-ai / local-deployment-llama-cpp

Project to help you get started working with LLMs locally with LLaMA C++.
Apache License 2.0
1 stars 1 forks source link

Add llama server reranking api notebook #22

Closed davidrpugh closed 1 month ago

davidrpugh commented 1 month ago

This PR adds a simple example of how to create and use a reranking server using llama-serve.