search

run-llama / LlamaIndexTS

Data framework for your LLM applications. Focus on server side solution
https://ts.llamaindex.ai
MIT License
1.94k stars 360 forks source link

Support LLM Reranker #1423

Open johnmara-pc14 opened 2 weeks ago

johnmara-pc14 commented 2 weeks ago

Hi, I've built a chat application using llama_index typescript version.
Now, I want to add a reranker. I've tested in the python version the llm_rerank and I'm happy with the results.

My question is, since it is using LLM for rerank and not cross-encoder or other transformer, I do not see the need to be available only for python.
Is it in your plans to add a similar interface for ts?

himself65 commented 2 weeks ago

I think you can put custom postprocessor into LITS. But PR is welcome

marcusschiesser commented 1 week ago

Meanwhile you can try one of the existing re-rankers that we already have implemented: https://legacy.ts.llamaindex.ai/modules/node_postprocessors/