search

jay-joshy / question_cli

0 stars 0 forks source link

? do rerank through remote ollama? #13

Closed jay-joshy closed 2 months ago

jay-joshy commented 2 months ago

? possible to do? One of the bugs is that with many queries my PC doens't have enough GPU/CPU and it aborts and throws an error ?with some llamaindex package?

jay-joshy commented 2 months ago

Not possible, no Ollama model exists for the rerank model. Goal: API running on remote linux server that accepts List[str], query:str, top_k:int This should be relatively easy to implement