castorini / rank_llm

Repository for prompt-decoding using LLMs (GPT3.5, GPT4, Vicuna, and Zephyr)
http://rankllm.ai
Apache License 2.0
277 stars 36 forks source link

Ordering max length imposition #62

Open ronakice opened 5 months ago

ronakice commented 5 months ago

Can we always say that [1] > ... > [20] is always the same number of tokens as some random ordering? My hunch is yes, and I sure hope so because I added this logic for RankZephyr and now for RankGPT through Andre's PR.