search

parthsarthi03 / raptor

The official implementation of RAPTOR: Recursive Abstractive Processing for Tree-Organized Retrieval
https://arxiv.org/abs/2401.18059
MIT License
688 stars 98 forks source link

How put my own inference logic #4

Closed johngonzalez closed 4 months ago

johngonzalez commented 4 months ago

Thanks for your work. I have chat logic with my own code. For example I must use Azure Open AI. How I could incluye My own inference logic in some class using the raptor methodogy?

parthsarthi03 commented 4 months ago

Hey! You can define your own inference code by defining your custom SummarizationModel, QAModel, and Embedding model. We have a tutorial for this available here.

johngonzalez commented 4 months ago

Thanks, that is true. The library is very flexible. Maybe should be good idea make simple examples of this.