cvangysel pytrec_eval issues

cvangysel / pytrec_eval

pytrec_eval is an Information Retrieval evaluation tool for Python, based on the popular trec_eval.

http://ilps.science.uva.nl/

MIT License

281 stars 32 forks source link

issues

Newest

Newest Most commented Recently updated Oldest Least commented Least recently updated

Using pytrec_eval.RelevanceEvaluator, do we sort the results internally or use as it is provides?

#53 SDcodehub opened 1 month ago
1
TypeError: Expected object_relevance_per_qid dictionary and measures set.

#52 guenthermi opened 3 months ago
2
The difference between pytrec_eval and sklearn ndcg_score and differ when change the dict key name

#51 relic-yuexi closed 1 month ago
2
How to handle duplicate document IDs?

#50 mrdrozdov opened 3 months ago
1
Faulty Scores Generated by Evaluator in Presence of Empty Relevance Sets

#49 DeepaliP98 opened 4 months ago
0
ERROR: Could not build wheels for pytrec-eval, which is required to install pyproject.toml-based projects

#48 diyicheng opened 4 months ago
7
CI/CD friendly wheel

#47 mooreniemi opened 10 months ago
0
For those with SSL issues here is the fix:

#46 EdwardBurgin opened 10 months ago
1
windows 10 installation

#45 malinphy opened 11 months ago
2
Not sure license can be MIT

#44 diegoceccarelli opened 1 year ago
3
Issues when installing on Mac m1

#43 tobicoveo opened 1 year ago
0
error when installing using pip

#42 issam-hub closed 1 year ago
6
iprec_at_recall trec_eval: duplicate cutoffs detected

#41 StamTheo28 opened 1 year ago
0
ndcg_cut.10 and -M 10 ndcg are different when multiple level of relevance is given.

#40 Taosheng-ty opened 1 year ago
2
Python 3.11 support

#39 cmacdonald closed 1 year ago
1
RelevanceEvaluator breaks when evaluating on multiple runs

#38 seanmacavaney opened 1 year ago
0
Range of doc score in run file

#37 cramraj8 opened 2 years ago
1
pytrec-eval-terrier 0.5.1

#36 nimasadri11 opened 2 years ago
4
List of supported metrics

#35 dhairyadalal opened 3 years ago
1
Pytrec scores are not consistent in colab

#34 sadakmed closed 3 years ago
9
use github actions to build Windows releases for pypi

#33 cmacdonald opened 3 years ago
0
Pip install error on windows 10, possible hardcoded path

#32 Alkouf opened 3 years ago
19
https://github.com/cvangysel/pytrec_eval/issues/8

#31 hosseinfani opened 3 years ago
0
use complete set of queries from relevance judgments (-c)

#30 seanmacavaney closed 2 years ago
1
Adding judged_only and allowing negative relevance_level

#29 seanmacavaney opened 3 years ago
0
Fix the build process.

#28 cvangysel closed 3 years ago
0
Windows support, Github Actions

#27 cmacdonald closed 3 years ago
2
Windows actions

#26 cmacdonald closed 4 years ago
1
enable github action testing

#25 cmacdonald closed 4 years ago
1
Could you please explain how does the evaluation work when the grades are taken from two different ranges?

#24 rodinasophie closed 4 years ago
1
Fix for clang 11 (OS X 10.15)

#23 bpiwowar closed 3 years ago
2
Metrics missing when running evaluator twice

#22 dfdazac opened 4 years ago
0
new release?

#21 cmacdonald opened 4 years ago
8
issue with pip install in mac

#20 Ali-H-Vahid closed 3 years ago
2
make a binary build for Windows

#19 cmacdonald opened 4 years ago
2
nicknames, metric parameters, empty inputs, and memory leaks

#18 seanmacavaney closed 4 years ago
5
support measure family nicknames

#17 cmacdonald opened 4 years ago
2
why relevance scores should be only Integers?

#16 amirj opened 4 years ago
1
Memory leak problem

#15 navid-rekabsaz opened 5 years ago
3
Tips to fasten the process

#14 Ricocotam opened 5 years ago
0
kernel will die with empty inputs

#13 amirj opened 5 years ago
1
Custom k for cut metrics

#12 ghost opened 5 years ago
3
Configure continuous integration.

#11 cvangysel closed 5 years ago
0
Python3.7 fix (retro-compatible)

#10 Ricocotam closed 5 years ago
1
python 3.7 support

#9 seanmacavaney closed 5 years ago
2
fail to install for Mac due to support of libc++ in place of stdlibc++ in the latest MacOS

#8 yifanclifford opened 5 years ago
5
support matching scores as ints

#7 cmacdonald closed 5 years ago
1
Matching scores cannot be ints

#6 cmacdonald closed 5 years ago
4
Would be nice to support directly loading TREC run and qrel files directly

#5 cmacdonald opened 5 years ago
3
Qrel Relevance scores between 1 to 5

#4 amirj closed 5 years ago
1