run-llama / llama-hub

A library of data loaders for LLMs made by the community -- to be used with LlamaIndex and/or LangChain
https://llamahub.ai/
MIT License
3.44k stars 732 forks source link

Implement raptor indexing engine (collapsed tree) #924

Open MarouaneMaatouk opened 8 months ago

MarouaneMaatouk commented 8 months ago

Description [WIP]

Implement RAPTOR: Recursive Abstractive Processing For Tree-Organized Retrieval paper: https://arxiv.org/pdf/2401.18059.pdf

Fixes # (issue)

Type of Change

Please delete options that are not relevant.

How Has This Been Tested?

Please describe the tests that you ran to verify your changes. Provide instructions so we can reproduce. Please also list any relevant details for your test configuration

Suggested Checklist:

logan-markewich commented 8 months ago

@MarouaneMaatouk can you run make lint to fix the linting errors?

jerryjliu commented 7 months ago

hey @MarouaneMaatouk - quick bump on this. once it's ready we'll help you port it over to llama_index (with the v0.10 upgrades packs are consolidated into the main repo)