braindatalab gecobench issues

braindatalab / gecobench

NLP Benchmark for XAI methods

BSD 3-Clause "New" or "Revised" License

3 stars 1 forks source link

issues

Newest

Newest Most commented Recently updated Oldest Least commented Least recently updated

Incomplete gender perturbations in the subject dataset

#84 ege-erdogan opened 1 month ago
1
Zero shot bert

#83 rickwg closed 1 month ago
0
Add relative mass accuracy score

#82 rickwg closed 1 month ago
0
update datasets

#81 venondev closed 2 months ago
3
fix subj pronoun special cases

#80 venondev closed 2 months ago
0
Add non binary gender support

#79 rickwg closed 2 months ago
3
Add neutral gender to dataset 2

#78 venondev closed 2 months ago
0
Add neutral gender to dataset

#77 rickwg closed 2 months ago
0
Fix masked bias metric

#76 venondev closed 5 months ago
0
Create alternative prediction difference plot

#75 venondev closed 5 months ago
0
Add rudimentary functionality of mlm model bias metric

#74 rickwg closed 5 months ago
2
Update eval

#73 venondev closed 5 months ago
0
Update correctly classified samples

#72 rickwg closed 6 months ago
0
Fix/html sentence plots

#71 venondev closed 6 months ago
0
Fix/visualization

#70 venondev closed 6 months ago
0
Bias classification metrics

#69 ArturDev42 closed 6 months ago
0
fix gt creation bug for last 3 indices

#68 venondev closed 6 months ago
0
We usw the right latex template

#67 ArturDev42 closed 5 months ago
0
Fix explanation sum bug & replace correlation with covariance

#66 venondev closed 6 months ago
0
Bias metrics

#65 ArturDev42 closed 6 months ago
0
Evaluate model prediction performance and fix visualizations

#64 venondev closed 6 months ago
0
Add prediction for model evaluation

#63 venondev closed 6 months ago
0
Bug: No optimizer.zero_grad in training function

#62 venondev closed 6 months ago
0
Research bias metrics for classification models

#61 ArturDev42 closed 5 months ago
1
Decide which dataset to use for gender (subsampling / no subsampling)

#60 venondev closed 5 months ago
1
Research bias metrics for datasets only

#59 ArturDev42 closed 5 months ago
0
Possible normalization strategy for matrix sums of co-occurence metric

#58 ArturDev42 closed 5 months ago
2
Add lr sweep & fix gradient accumulation

#57 venondev closed 6 months ago
0
fix save versions

#56 venondev closed 7 months ago
0
Research applicable classification bias metric for models

#55 ArturDev42 closed 5 months ago
1
Data (train, test.jsonl) does not contain both gender sentences

#54 ArturDev42 closed 6 months ago
3
Bias metrics

#53 ArturDev42 closed 7 months ago
1
add ground truth to train jsonl dataset

#52 venondev closed 7 months ago
0
Add tf-idf normalization

#51 venondev closed 7 months ago
1
fix sum for gradient shap

#50 venondev closed 7 months ago
0
Location of the dataframe.pkl files needed for generate_data.py

#49 ArturDev42 closed 6 months ago
1
Provisioning of our datasets

#48 ArturDev42 closed 7 months ago
1
We have a normalization strategy for computing word-based most common feature attribution

#47 rickwg closed 6 months ago
0
fix lime & gradient shap

#46 venondev closed 7 months ago
0
Bug: Gradient Shap

#45 venondev closed 7 months ago
0
Add normalized attribution plot and fix spacing for sentence wise plot

#44 venondev closed 7 months ago
1
Add comments in the code

#43 ArturDev42 closed 6 months ago
0
Add explanation in README on how to use poetry

#42 ArturDev42 closed 5 months ago
0
Add sentiment visualizations

#41 venondev closed 7 months ago
1
Add vanilla attention model

#40 rickwg closed 7 months ago
0
Fix xai paths and add pred step

#39 venondev closed 8 months ago
1
Implement Bias Metrics (DisCO, LPBS)

#38 ArturDev42 closed 6 months ago
0
add sentence idx to gender dataset

#37 venondev closed 8 months ago
2
Add correlation between words and target as additional baseline method

#36 rickwg closed 8 months ago
0
Fix artifact and record paths

#35 rickwg closed 8 months ago
0