add Biqwen + bug fix from #59 + deterministic behavior

illuin-tech / vidore-benchmark

Vision Document Retrieval (ViDoRe): Benchmark. Evaluation code for the ColPali paper.

https://huggingface.co/vidore

MIT License

135 stars 15 forks source link

Closed ManuelFay closed 3 weeks ago

ManuelFay commented 3 weeks ago

Big bug in previous commit #59 @tonywu71
Deterministic behavior during set construction for reproducibility
- Seems muuuch better but still get 0.00003 difference on tatdqa for some reason, the others are exactly equal
add biQwen

ManuelFay commented 3 weeks ago

Merging with no reviews because it patches a big bug, will need to do review a posteriori @tonywu71