harvard-edge dataperf-speech-example issues

harvard-edge / dataperf-speech-example

Example workflow for our data-centric speech benchmark

17 stars 11 forks source link

issues

Newest

Newest Most commented Recently updated Oldest Least commented Least recently updated

averages the eval score over multiple seeds

#28 colbybanbury closed 1 year ago
0
advertise colab

#27 mmaz closed 1 year ago
0
wip on launch docs

#26 mmaz closed 1 year ago
0
adds the ability to control the training set size and updates the README

#25 colbybanbury closed 1 year ago
0
colab example

#24 mmaz closed 1 year ago
1
adding support for multiple languages

#23 colbybanbury closed 1 year ago
1
WARNING Docker image (mlcommons/dataperf:0.0.1) does not exist or build strategy is 'always'

#22 Zikovich opened 1 year ago
1
Update MLCube readme [WIP]

#21 davidjurado opened 1 year ago
1
Update cleanlab selection baseline for balanced_accuracy evaluation

#20 jwmueller closed 1 year ago
1
replace train.json -> train.yaml in readme instructions

#19 jwmueller closed 1 year ago
1
clarify MLcube is optional

#18 jwmueller closed 1 year ago
1
clarify what the task is more precisely

#17 jwmueller closed 1 year ago
0
setup instructions don't work for me: "mlcube is not a package" error

#16 jwmueller opened 1 year ago
5
json output

#15 mmaz closed 2 years ago
0
MLCube selection config bugfix

#14 colbybanbury closed 2 years ago
0
Updating the README to reflect the MLCube workflow

#13 colbybanbury closed 2 years ago
0
expose the config in subclasses

#12 mmaz closed 2 years ago
0
sort label ids lexicographically across train and eval in eval.py

#11 mmaz closed 2 years ago
0
Update readme

#10 davidjurado closed 2 years ago
0
Balanced scoring and separate selection files

#9 colbybanbury closed 2 years ago
0
Add cleanlab as baseline method

#8 jwmueller closed 2 years ago
0
Feat/xfold val

#7 mmaz closed 2 years ago
0
should we switch to non-stratified shufflesplit in selection.py?

#6 mmaz opened 2 years ago
0
reduce memory usage during evaluation

#5 mmaz closed 2 years ago
0
coalesce calls to open for parquets

#4 mmaz closed 2 years ago
0
allow participants to extend config file

#3 mmaz opened 2 years ago
0
Multiclass interface

#2 colbybanbury closed 2 years ago
1
Add MLCube integration

#1 davidjurado closed 2 years ago
2