Yale-LILY SummEval issues

Yale-LILY / SummEval

Resources for the "SummEval: Re-evaluating Summarization Evaluation" paper

MIT License

374 stars 42 forks source link

issues

Newest

Newest Most commented Recently updated Oldest Least commented Least recently updated

Where do the references come from?

#55 slvcsl opened 3 weeks ago
0
Dockerize the project

#54 simonesestito opened 5 months ago
0
How to match reference summary that was used by the expert to grade a given machine summary.

#53 erastogi opened 5 months ago
3
rouge-we: Fix download timeout

#52 Kripner opened 8 months ago
0
Replace printing with logging

#51 JJMinton opened 1 year ago
0
Replace 'stderr' with 'sys.stderr' to fix `NameError`

#50 Kripner opened 1 year ago
1
summa_qa is not working

#49 nilanjansircar80 opened 1 year ago
0
ROUGE-WE relies on a download link that no longer works

#48 alichte opened 1 year ago
2
Bugfixes

#47 JJMinton opened 1 year ago
0
Use poetry

#46 JJMinton opened 1 year ago
0
Update rouge install commands

#45 JJMinton closed 1 year ago
0
Can not reproduce the rouge score.

#44 SefaZeng opened 1 year ago
0
which 16 models to generate the human annotation results

#43 dzf0023 opened 1 year ago
0
Cost spent on human annotation

#42 LiyingCheng95 opened 1 year ago
0
Identifying individual annotators

#41 eryk-mazus closed 1 year ago
3
Unittests fail

#40 oriern opened 2 years ago
2
Unable to import the package

#39 29riyasaxena opened 2 years ago
2
Error running Meteor metric

#38 JeetRoy97 opened 2 years ago
0
SummaQAMetric: NameError name 'stderr' is not defined

#37 ankitk2109 closed 2 years ago
1
SupertMetric: sentence_transformers module not found

#36 ankitk2109 opened 2 years ago
2
Can't install the package

#35 stefcon opened 2 years ago
0
error while running setup on windows

#34 shankyemcee closed 2 years ago
1
Says Illegal instruction for running command line argument

#33 shankyemcee opened 2 years ago
0
Errors after installing via pip and fixes

#32 ankitk2109 opened 2 years ago
0
ValueError: Found array with 0 sample(s) (shape=(0, 1024)) while a minimum of 1 is required by check_pairwise_arrays.

#31 paluchasz opened 2 years ago
0
Fix the description at pypi.org

#30 SubhamBurnwal closed 2 years ago
1
update stopwords.txt

#29 darioTecchia closed 2 years ago
0
Error during installation

#28 darioTecchia opened 2 years ago
3
PR to add new metric results

#27 PierreColombo opened 3 years ago
1
Fix SummaQA MoverScore S^3

#26 NKWBTB closed 3 years ago
0
mover metric

#25 martin6336 opened 3 years ago
0
corpus_chrf() got an unexpected keyword argument 'order'

#24 martin6336 closed 2 years ago
2
Fix dirname not found

#23 jpwahle closed 3 years ago
0
Fix jsonl keys for calc-score input

#22 jantrienes closed 3 years ago
0
Value Error in Bert_Score_Metric

#21 StephenMal closed 2 years ago
2
Unable to install

#20 amanyakhyar opened 3 years ago
2
sys.exit import missing in supert_metric.py

#19 zakhan4 closed 2 years ago
8
How can I get "model_annotations.aligned.scored.jsonl"

#18 vincent1rookie closed 3 years ago
1
Code to Reproduce System-Level Metrics

#17 mingkaid closed 3 years ago
13
fixed bug in chrf++code

#16 tanay2001 closed 3 years ago
0
MeteorMetric.evaluate_batch(hyps, refs) fails with error: BrokenPipeError: [Errno 32] Broken pipe

#15 zakhan4 closed 3 years ago
2
Unable to install dependency (wmd)

#14 anjalibshah opened 3 years ago
3
Help Reproducing the Results

#13 PierreColombo closed 3 years ago
7
Error with ROUGE

#12 PierreColombo closed 3 years ago
1
Installing backend dependencies ... error

#11 PPGHPP closed 3 years ago
10
Version Conflict error

#10 Rumi4 closed 3 years ago
4
Is it possible to release a table of all paired data and scoring results?

#9 johntzwei closed 3 years ago
5
Data format questions

#8 danieldeutsch closed 4 years ago
2
Punctuation not consistent for M19 (Text Summarization with Pretrained Encoders)

#7 artidoro opened 4 years ago
3
The example doesn't work.

#6 dominik-schwabe closed 4 years ago
2