parthsarthi03 / raptor

The official implementation of RAPTOR: Recursive Abstractive Processing for Tree-Organized Retrieval
https://arxiv.org/abs/2401.18059
MIT License
686 stars 98 forks source link

Testing scripts #48

Open jsvan opened 4 days ago

jsvan commented 4 days ago

Discussed in https://github.com/parthsarthi03/raptor/discussions/47

Originally posted by **jsvan** July 3, 2024 Hello, Could you please share the testing scripts for the Narrative/QuALITY/Qasper scores? I'd like to run some experiments on how quantization/reducing embedding dimensions affect performance. However running these look non trivial because it's information retrieval/generation etc., and I'm trying to fit this in while procrasting from other work I should be doing. Thank you!
piscesfinalizer commented 3 days ago

me too