issues
search
cvangysel
/
pytrec_eval
pytrec_eval is an Information Retrieval evaluation tool for Python, based on the popular trec_eval.
http://ilps.science.uva.nl/
MIT License
281
stars
32
forks
source link
issues
Newest
Newest
Most commented
Recently updated
Oldest
Least commented
Least recently updated
Using pytrec_eval.RelevanceEvaluator, do we sort the results internally or use as it is provides?
#53
SDcodehub
opened
1 month ago
1
TypeError: Expected object_relevance_per_qid dictionary and measures set.
#52
guenthermi
opened
3 months ago
2
The difference between pytrec_eval and sklearn ndcg_score and differ when change the dict key name
#51
relic-yuexi
closed
1 month ago
2
How to handle duplicate document IDs?
#50
mrdrozdov
opened
3 months ago
1
Faulty Scores Generated by Evaluator in Presence of Empty Relevance Sets
#49
DeepaliP98
opened
4 months ago
0
ERROR: Could not build wheels for pytrec-eval, which is required to install pyproject.toml-based projects
#48
diyicheng
opened
4 months ago
7
CI/CD friendly wheel
#47
mooreniemi
opened
10 months ago
0
For those with SSL issues here is the fix:
#46
EdwardBurgin
opened
10 months ago
1
windows 10 installation
#45
malinphy
opened
11 months ago
2
Not sure license can be MIT
#44
diegoceccarelli
opened
1 year ago
3
Issues when installing on Mac m1
#43
tobicoveo
opened
1 year ago
0
error when installing using pip
#42
issam-hub
closed
1 year ago
6
iprec_at_recall trec_eval: duplicate cutoffs detected
#41
StamTheo28
opened
1 year ago
0
ndcg_cut.10 and -M 10 ndcg are different when multiple level of relevance is given.
#40
Taosheng-ty
opened
1 year ago
2
Python 3.11 support
#39
cmacdonald
closed
1 year ago
1
RelevanceEvaluator breaks when evaluating on multiple runs
#38
seanmacavaney
opened
1 year ago
0
Range of doc score in run file
#37
cramraj8
opened
2 years ago
1
pytrec-eval-terrier 0.5.1
#36
nimasadri11
opened
2 years ago
4
List of supported metrics
#35
dhairyadalal
opened
3 years ago
1
Pytrec scores are not consistent in colab
#34
sadakmed
closed
3 years ago
9
use github actions to build Windows releases for pypi
#33
cmacdonald
opened
3 years ago
0
Pip install error on windows 10, possible hardcoded path
#32
Alkouf
opened
3 years ago
19
https://github.com/cvangysel/pytrec_eval/issues/8
#31
hosseinfani
opened
3 years ago
0
use complete set of queries from relevance judgments (-c)
#30
seanmacavaney
closed
2 years ago
1
Adding judged_only and allowing negative relevance_level
#29
seanmacavaney
opened
3 years ago
0
Fix the build process.
#28
cvangysel
closed
3 years ago
0
Windows support, Github Actions
#27
cmacdonald
closed
3 years ago
2
Windows actions
#26
cmacdonald
closed
4 years ago
1
enable github action testing
#25
cmacdonald
closed
4 years ago
1
Could you please explain how does the evaluation work when the grades are taken from two different ranges?
#24
rodinasophie
closed
4 years ago
1
Fix for clang 11 (OS X 10.15)
#23
bpiwowar
closed
3 years ago
2
Metrics missing when running evaluator twice
#22
dfdazac
opened
4 years ago
0
new release?
#21
cmacdonald
opened
4 years ago
8
issue with pip install in mac
#20
Ali-H-Vahid
closed
3 years ago
2
make a binary build for Windows
#19
cmacdonald
opened
4 years ago
2
nicknames, metric parameters, empty inputs, and memory leaks
#18
seanmacavaney
closed
4 years ago
5
support measure family nicknames
#17
cmacdonald
opened
4 years ago
2
why relevance scores should be only Integers?
#16
amirj
opened
4 years ago
1
Memory leak problem
#15
navid-rekabsaz
opened
5 years ago
3
Tips to fasten the process
#14
Ricocotam
opened
5 years ago
0
kernel will die with empty inputs
#13
amirj
opened
5 years ago
1
Custom k for cut metrics
#12
ghost
opened
5 years ago
3
Configure continuous integration.
#11
cvangysel
closed
5 years ago
0
Python3.7 fix (retro-compatible)
#10
Ricocotam
closed
5 years ago
1
python 3.7 support
#9
seanmacavaney
closed
5 years ago
2
fail to install for Mac due to support of libc++ in place of stdlibc++ in the latest MacOS
#8
yifanclifford
opened
5 years ago
5
support matching scores as ints
#7
cmacdonald
closed
5 years ago
1
Matching scores cannot be ints
#6
cmacdonald
closed
5 years ago
4
Would be nice to support directly loading TREC run and qrel files directly
#5
cmacdonald
opened
5 years ago
3
Qrel Relevance scores between 1 to 5
#4
amirj
closed
5 years ago
1
Next