issues
search
GenBench
/
genbench_cbt_2023
The official Genbench Collaborative Benchmarking Task repository 2023 (Archived)
Other
14
stars
18
forks
source link
issues
Newest
Newest
Most commented
Recently updated
Oldest
Least commented
Least recently updated
Add the archival notice
#43
kazemnejad
closed
3 months ago
0
Allow the test to pass if custom implementation is used
#42
kazemnejad
closed
10 months ago
0
[Task Submission] Natural Language Codesearch Classification (`nl_codesearch_clf`)
#41
kazemnejad
closed
10 months ago
0
Add statsmodels
#40
kazemnejad
closed
10 months ago
0
[Task Submission] Cross Lingual Consistency (`cross_lingual_consistency`)
#39
Betswish
closed
10 months ago
2
Cross Lingual Consistency of Factual Knowledge
#38
Betswish
closed
11 months ago
0
[Task Submission] Hate Speech Detection (`latent_feature_splits`)
#37
MaikeZuefle
closed
10 months ago
0
Using additional packages
#36
LucWeber
opened
1 year ago
5
n_shots field creates fewshot queries with n+1 examples
#35
Samarendra109
opened
1 year ago
1
Nl codesearch clf
#34
drndr
closed
1 year ago
1
[Task Submission] Divergent DepRel Distributions (`europarl_dbca_splits`)
#33
anmoisio
closed
10 months ago
7
Extra arguments for hf dataset loading
#32
anmoisio
opened
1 year ago
2
[Task Submission] Prompt ComVE
#31
lranaldii
opened
1 year ago
3
[Task Submission] Prompt ComVE
#30
lranaldii
closed
1 year ago
0
custom task_type and evaluation_metrics - test-task errors
#29
drndr
opened
1 year ago
0
[Task Submission] OOV Generalisation Challenge (`oov_generalisation`)
#28
kbatsuren
closed
1 year ago
2
[Task Submission] Natural Language Codesearch Ranking (`nl_codesearch_mrr`)
#27
drndr
closed
10 months ago
6
[Task Submission] Cross_lingual Local QA (`cross_lingual_local_qa`)
#26
lkra
closed
1 year ago
2
test-task check for merge with multiple task_ids
#25
drndr
closed
1 year ago
1
[Task Submission] Reasoning about Ambiguous Definite Descriptions (`reasoning_ambiguous_definite_descriptions`)
#24
sfschouten
closed
1 year ago
2
[Task Submission] Bias-amplified Splits (`bias_amplified_splits`)
#23
yreif
opened
1 year ago
7
[Task Submission] OperationsResearchQA (`operationsresearchqa`)
#22
OpResearchQA
closed
1 year ago
5
[Task Submission] OperationsResearchQA (`operationsresearchqa`)
#21
OpResearchQA
closed
1 year ago
0
[Task Submission] Quantifier Understanding (`quantifier_understanding`)
#20
lerow
opened
1 year ago
3
[Task Submission] Multilingual SCAN (`multilingual_scan`)
#19
ameliereymond
opened
1 year ago
3
[Task Submission] Quantifier Understanding (`quantifier_understanding`)
#18
lerow
closed
1 year ago
0
Issue with extracting the task name from the submission title
#17
CLCL-Geneva
closed
1 year ago
4
[Task Submission] Natural Language Codesearch Classification (`nl_codesearch_clf `)
#16
drndr
closed
10 months ago
9
[Task Submission] Divergent DepRel Distributions (`dbca_deprel`)
#15
anmoisio
closed
1 year ago
5
[Task Submission] BLM_tasks (`blm_tasks`)
#14
CLCL-Geneva
opened
1 year ago
1
Question about auto-check
#13
Betswish
closed
1 year ago
6
[Task Submission] Hate Speech Detection (`latent_feature_split`)
#12
MaikeZuefle
closed
11 months ago
3
[Task Submission] ICL consistency test (`icl_consistency_test`)
#11
LucWeber
closed
10 months ago
1
[Task Submission] Shifted Pauq (`shifted_pauq`)
#10
ai-spiderweb
opened
1 year ago
2
[Task Submission] Cross Lingual Consistency (`cross_lingual_consistency`)
#9
Betswish
closed
11 months ago
15
Bmlama
#8
Betswish
closed
1 year ago
0
task type test suite mismatch
#7
drndr
closed
1 year ago
1
[Task Submission] Frequency based mathematics (`frequency_based_mathematics`)
#6
dieuwkehupkes
closed
10 months ago
0
[Task Submission] Training dynamics split for WiC (`traindyn_wic`)
#5
vernadankers
closed
10 months ago
0
[Task Submission] My Awesome Task Dict (`my_awesome_task_dict`)
#4
kazemnejad
closed
1 year ago
0
[Task Submission] Sample Task 22 (`sample_task_22`)
#3
kazemnejad
closed
1 year ago
0
Add new task
#2
kazemnejad
closed
1 year ago
0
Final touches
#1
kazemnejad
closed
1 year ago
0