search

Capstone-S17 / DuRAG

0 stars 0 forks source link

Rerank then AMR or AMR then rerank? #8

Closed Dhanushkmr closed 3 months ago

Dhanushkmr commented 3 months ago

reranker context length is only 512, AMR chunks can get as big as 2048 which won't fit. how best to approach this?

Dhanushkmr commented 3 months ago

the current steps are: retrieve, do first level aggregation (max 512 tokens), rerank, then second level aggregation, then generate.

@hungchiayu1 @victoriachong