issues
search
Unbabel
/
COMET
A Neural Framework for MT Evaluation
https://unbabel.github.io/COMET/html/index.html
Apache License 2.0
439
stars
72
forks
source link
issues
Newest
Newest
Most commented
Recently updated
Oldest
Least commented
Least recently updated
[QUESTION] predict multiple times with a model
#222
dh-Kang
opened
5 days ago
0
Update README.md
#221
mtreviso
closed
5 days ago
0
I see Unbabel comet is downloading models--xlm-roberta-large folder every time, is there any way to load it from local, if yes please share the hack.[QUESTION]
#220
atuad7535
opened
1 week ago
1
Add missing library stubs or py.typed marker
#219
jblemoine
opened
1 month ago
0
Updated Readme with news about DocCOMET and variants
#218
sweta20
closed
2 months ago
0
Training data and scripts used for wmt22-cometkiwi-da
#217
rohitk-cognizant
opened
2 months ago
3
[QUESTION] Comet kiwi architecture
#216
vince62s
closed
4 weeks ago
11
Enable Document Extension of COMET
#215
sweta20
closed
2 months ago
0
[QUESTION] why num_layers = num_hidden_layers + 1
#214
vince62s
closed
2 months ago
1
[QUESTION] OOM when load XCOMET-XXL in A100 with 40G memory for prediction
#213
Nie-Yingying
opened
2 months ago
4
Safetensors Support
#212
upunaprosk
opened
2 months ago
0
Training script for XCOMET
#211
babangain
closed
2 months ago
1
Change the global variable logger to comet_logger
#210
vince62s
opened
3 months ago
1
[INPUT] Text Length of Input (source, reference, and hypothesis)
#209
foreveronehundred
opened
3 months ago
2
[QUESTION] Memory footprint
#208
vince62s
closed
3 months ago
21
[QUESTION] Splitting big models over multiple GPUs
#207
zouharvi
opened
4 months ago
6
[QUESTION] large file scoring
#206
vince62s
closed
3 months ago
3
Set default workers=0 for Windows
#205
BramVanroy
closed
3 months ago
1
Different versions of COMET code give different scores with the same model and date.
#204
bhaddow
closed
4 months ago
0
Different scores from different COMET package versions 1.1.2 and 2.2.1
#203
PinzhenChen
opened
4 months ago
2
Runtime error when loading wmt23-cometkiwi-da-xl
#202
radka-j
closed
4 months ago
1
what is the precision when load_from_checkpoint?
#201
haorannlp
opened
4 months ago
0
Fix typo in README.md
#200
gpengzhi
closed
3 months ago
1
Minimizing cpu RAM vs only use GPU RAM
#199
vince62s
closed
4 weeks ago
1
Bump aiohttp from 3.9.1 to 3.9.2
#198
dependabot[bot]
opened
5 months ago
0
Fix invalid link reference of reference-free model in readme
#197
new5558
closed
5 months ago
1
Invalid link reference of reference-free model in readme
#196
new5558
closed
5 months ago
0
Sparsemax not actually used in COMET-KIWI, XCOMET-XL/XXL
#195
emjotde
opened
5 months ago
4
[QUESTION] Train UnifiedMetric/XCOMET with word level predictions.
#194
zolastro
opened
5 months ago
1
Bump jinja2 from 3.1.2 to 3.1.3
#193
dependabot[bot]
opened
5 months ago
0
if tgt is same with src, the score is still high
#192
ZeroneBo
closed
4 months ago
2
HF Hub dependency conflicts with latest `tranformers` version.
#191
scottfleming
closed
5 months ago
3
[QUESTION] Keep getting scores of '0' no matter what input used
#190
Brecony76
closed
3 months ago
5
[QUESTION] Unable to use ReLU as activation function
#189
nkw011
closed
5 months ago
4
When loading huggingface Unbabel/wmt22-cometkiwi-da checkpoint, UnpicklingError
#188
efsotr
closed
7 months ago
0
Bump aiohttp from 3.8.5 to 3.9.0
#187
dependabot[bot]
closed
5 months ago
0
AttributeError: 'dict' object has no attribute 'scores' when using the model 'Unbabel/wmt22-cometkiwi-da'
#186
ArchchanaKugathasan
closed
7 months ago
4
Update base.py Fixes: AttributeError: 'dict' object has no attribute 'scores'
#185
ymoslem
closed
7 months ago
1
[QUESTION] AttributeError: An error occurred during model prediction: 'dict' object has no attribute 'scores'
#184
Evstrife
closed
7 months ago
5
AttributeError: 'dict' object has no attribute 'scores'
#183
ymoslem
closed
5 months ago
2
Update README.md
#182
eltociear
closed
7 months ago
0
Bump aiohttp from 3.8.5 to 3.8.6
#181
dependabot[bot]
closed
7 months ago
1
[QUESTION] Reliability for en-th and th-en pair
#180
zzzzzzzzzzzzz
closed
6 months ago
2
Mismatch between error span and offsets
#179
danieldeutsch
closed
5 months ago
2
Fix multi-gpu inference
#178
arturnn
closed
5 months ago
1
Multi-gpu inference returns AttributeError
#177
arturnn
closed
5 months ago
7
[QUESTION] Train Your Own Metric
#176
ecroxford
opened
8 months ago
2
what aspects of language get considered while evaluating the translation by COMET. as far as I am aware of MQM metrics are covered in it. Interested in knowing other terminology/features of language gets in COMET. I am looking for metric along with COMET that can assess the translated content for cosmetic domain data. please suggest.
#175
suyogkute
opened
8 months ago
1
whar aspects of language gets considered while evaluating the tranlsation by COMET. as far as I am aware of MQM metric sare covered in it. Interested to know other terminolofy/features of language gets in COMET.
#174
suyogkute
closed
8 months ago
1
V2.2.0
#173
ricardorei
closed
8 months ago
0
Next