run-llama / LlamaIndexTS

LlamaIndex in TypeScript
https://ts.llamaindex.ai
MIT License
1.73k stars 330 forks source link

Using ColBERT with LLaMAIndex TS #1044

Open purvapruthi opened 1 month ago

purvapruthi commented 1 month ago

Is there a way to integrate ColBERT or RAGaTouille based indices directly with LLaMAIndexTS, without using Python backend? I am trying to build lightweight RAG application but want to use ColBERT as it is working best for my use-case. Any help would be appreciated.

marcusschiesser commented 1 month ago

@purvapruthi you mean your feature request is to add Colbert reranker (see https://docs.llamaindex.ai/en/stable/examples/node_postprocessor/ColbertRerank/)?

purvapruthi commented 1 month ago

I meant a feature to use Ragatouille created indices and Colbert model for retrieval with LLaMA-index TS, similar to the retriever pack we have in Python: https://llamahub.ai/l/llama-packs/llama-index-packs-ragatouille-retriever?from=llama-packs