create stratified batches in Dataset classes - Githubissues

ulf1 / sentence-embedding-evaluation-german

Basically SentEval with German language downstream tasks

Apache License 2.0

0 stars 1 forks source link

create stratified batches in Dataset classes #17

Closed ulf1 closed 2 years ago

ulf1 commented 2 years ago

all validations sets with sklearn stratified
scale the remaining training data with np.choice an p=w up
get_class_weights