search

webis-de / RENEUIR-24

The participation of the FSU team at ReNeuIR 2024.
1 stars 0 forks source link

Model selection #11

Open Integer-Ctrl opened 2 weeks ago

Integer-Ctrl commented 2 weeks ago
mam10eks commented 1 week ago

The extraction of the dataset is now started, will likely run for one or two hours.

I still need to add the code for running the predictions.

mam10eks commented 1 week ago

The dataset is finished, I started the evaluation for the distillation models. For reference, the dataset is here: https://files.webis.de/data-in-progress/data-research/web-search/reneuir-24/msmarco-dev-dataset/rerank.jsonl.gz

mam10eks commented 1 week ago

The evaluation scripts are now finished, we only need to run it on the dataNew evaluation script to select models is here: https://github.com/webis-de/RENEUIR-24/blob/main/code/evaluation.ipynb

mam10eks commented 1 week ago

Offen: