inspired-co eaas_client issues

inspired-co / eaas_client

Evaluation as a Service for NLP

https://inspired-co.github.io/eaas_client/

Apache License 2.0

9 stars 1 forks source link

issues

Newest

Newest Most commented Recently updated Oldest Least commented Least recently updated

Connection error: using `comet_qe` on meta evaluation set `meval_summeval/coherence`

#26 pfliu-nlp opened 1 year ago
0
User Story: Use `bart_score_mt` as a metric to filter generated paraphrased text

#25 pfliu-nlp opened 2 years ago
1
Fix error message printing

#24 neubig closed 2 years ago
1
The detailed documentation doesn't have the Client(Config())

#23 neubig opened 2 years ago
0
Add stub files for MyPy

#22 neubig opened 2 years ago
0
Bump version to 0.3.9

#21 neubig closed 2 years ago
0
Added length ratio to endpoint config

#20 neubig closed 2 years ago
0
EaaS client should give more comprehensible error when it times out

#19 neubig opened 2 years ago
0
EaaS should support different input and output languages

#18 neubig opened 2 years ago
0
Fix doc and versioning

#17 neubig closed 2 years ago
0
Simplify client

#16 neubig closed 2 years ago
2
Move endpoint config out of client

#15 neubig closed 2 years ago
1
Make server requests simultaneous

#14 neubig closed 2 years ago
0
Add asynchronous client

#13 neubig closed 2 years ago
2
Serve sufficient statistics

#12 neubig closed 2 years ago
0
Move AsyncEaaSClient

#11 neubig closed 2 years ago
0
GPU number should be flexibly specified for all metrics?

#10 pfliu-nlp closed 2 years ago
0
Restart EaaS service automatically whenever it is down

#9 pfliu-nlp closed 2 years ago
0
EaaS service was down when testing a relatively large file from Shuyan

#8 pfliu-nlp closed 2 years ago
1
Add pre-commit hooks

#7 neubig closed 2 years ago
2
add `hello world` as quick example & update config usage

#6 pfliu-nlp closed 2 years ago
0
The readme and docs should be updated (e.g., config)

#5 pfliu-nlp closed 2 years ago
1
Add terms of use

#4 neubig closed 2 years ago
0
Move config to init

#3 neubig closed 2 years ago
1
Point to permanent URL

#2 neubig closed 2 years ago
2
Document (default) hyper-parameters for each metric

#1 pfliu-nlp closed 2 years ago
2