issues
search
huggingface
/
model-evaluator
Evaluate Transformers from the Hub 🔥
https://huggingface.co/spaces/autoevaluate/model-evaluator
Apache License 2.0
13
stars
7
forks
source link
issues
Newest
Newest
Most commented
Recently updated
Oldest
Least commented
Least recently updated
Archive project
#73
lewtun
closed
1 year ago
0
Catch metadata exceptions in autoevaluate datasets
#72
lewtun
closed
1 year ago
0
feat: 🎸 update after change in the datasets-server API response
#71
severo
closed
1 year ago
2
Extend support for the zero-shot text classification task to support encoder-decoder models
#70
mathemakitten
opened
2 years ago
0
Evaluation job crashes with "KeyError: eval_info" when submitted
#69
NimaBoscarino
closed
2 years ago
2
Enable usage with private datasets / models
#68
mathemakitten
opened
2 years ago
0
Filter models dropdown to those suitable for the task
#67
mathemakitten
opened
2 years ago
0
Add FLOPS to reporting of results
#66
mathemakitten
opened
2 years ago
0
Cap the number of zero-shot evaluations allowed simultaneously
#65
mathemakitten
opened
2 years ago
0
Extend zero-shot classification language task to support a generalized likelihood task
#64
mathemakitten
opened
2 years ago
0
Add semantic similarity task
#63
mathemakitten
opened
2 years ago
0
Warn users if model-to-be-evaluated does not have a model card
#62
mathemakitten
opened
2 years ago
0
Allow model evaluations to be re-run
#61
mathemakitten
opened
2 years ago
0
Support concurrent submissions
#60
mathemakitten
opened
2 years ago
0
Configure larger disks for bigger models
#59
mathemakitten
closed
2 years ago
1
Revert "Disable zeroshot classification"
#58
lewtun
closed
2 years ago
0
Disable zeroshot classification
#57
lewtun
closed
2 years ago
0
Fix AutoTrain provider
#56
lewtun
closed
2 years ago
0
Update README for text_zero_shot_classification
#55
mathemakitten
closed
2 years ago
0
CI against changes to Autotrain
#54
mathemakitten
opened
2 years ago
1
Fix dataset server endpoint call
#53
lewtun
closed
2 years ago
0
Add dataset config to AutoTrain project name
#52
lewtun
closed
2 years ago
0
Add NLI support
#51
lewtun
closed
2 years ago
0
Fix creds in cron job
#50
lewtun
closed
2 years ago
0
Trigger evaluations via cron job
#49
lewtun
closed
2 years ago
0
Modifications to zero-shot classification branch
#48
mathemakitten
closed
2 years ago
2
Fix bearer for AutoTrain projects
#47
lewtun
closed
2 years ago
0
Add AutoTrain backend API details
#46
lewtun
closed
2 years ago
0
add zero shot classification task
#45
TristanThrush
closed
2 years ago
3
Enable question answering
#44
lewtun
closed
2 years ago
0
Fix AutoTrain project name
#43
lewtun
closed
2 years ago
0
Store dataset ID in AutoTrain project name
#42
lewtun
closed
2 years ago
0
Enable any summarization model to be evaluated on any dataset
#41
lewtun
closed
2 years ago
0
Refactor model filter
#40
lewtun
closed
2 years ago
0
Add test for empty username
#39
lewtun
closed
2 years ago
0
fix for double dataset select bug
#38
TristanThrush
closed
2 years ago
0
Extend list of compatible models to include Text2Text models for translation / summarisation
#37
lewtun
opened
2 years ago
0
Add blog post URL
#36
lewtun
closed
2 years ago
0
Hotfix to handle datasets without metadata
#35
lewtun
closed
2 years ago
0
Disable support for question answering
#34
lewtun
closed
2 years ago
0
Hash user metrics
#33
lewtun
closed
2 years ago
0
Fix dataset card URLs
#32
lewtun
closed
2 years ago
0
Tweak metadata text
#31
lewtun
closed
2 years ago
0
Pass token to metadata getter
#30
lewtun
closed
2 years ago
0
Cap number of evaluations to 10
#29
lewtun
closed
2 years ago
0
Add notebooks to flush prediction repos
#28
lewtun
closed
2 years ago
0
Tweak project description
#27
lewtun
closed
2 years ago
0
Fix URLs for repo renaming
#26
lewtun
closed
2 years ago
0
Add username input for job notifications
#25
lewtun
closed
2 years ago
0
Add support for image classification
#24
lewtun
closed
2 years ago
0
Next