Can you share example CIC prompts for RAG and SQL ?

google-deepmind / loft

LOFT: A 1 Million+ Token Long-Context Benchmark

Apache License 2.0

125 stars 8 forks source link

Can you share example CIC prompts for RAG and SQL ? #3

Open EmGarr opened 2 months ago

EmGarr commented 2 months ago

Hi,

I am reimplementing the benchmark using the dataset you already released. Could you provide the CIC prompts for the SQL and RAG retrieval tasks? They were not clearly outlined in the paper. If you are planning to release the code soon, I can wait. However, if it might take a while, could you possibly share an example for each task? 😄

Thanks for your work! 👍

anthonywchen commented 1 month ago

Hi Emilien, thanks for checking out our paper! We will be releasing the evaluation code along with example prompts shortly, stay tuned!

JohnlNguyen commented 3 weeks ago

Any update on this? @anthonywchen