search

nvtransfer / RULER

This repo contains the source code for RULER: What’s the Real Context Size of Your Long-Context Language Models?
Apache License 2.0
646 stars 43 forks source link

Show Gemini Pro results #2

Closed s-macke closed 6 months ago

s-macke commented 6 months ago

Hi,

your paper doesn’t show Gemini Pro results with 1M tokens. Please test against this model.

hsiehjackson commented 6 months ago

We are working on testing gemini 1.5 pro. Please stay patient since the API has a restricted rate limit.

hsiehjackson commented 6 months ago

@s-macke we just release our codes and put gemini 1.5 pro results in our main table. Thanks for your patience.