search

braindatalab / gecobench

NLP Benchmark for XAI methods
BSD 3-Clause "New" or "Revised" License
3 stars 1 forks source link

Bias metrics #65

Closed ArturDev42 closed 6 months ago

ArturDev42 commented 6 months ago

male_terms = ['he', 'his', 'him'] female_terms = ['she', 'her', 'her']

Dataset: gender_all Matrix sum of S_male = 6211.0 Matrix sum of S_female = 8308.0

Dataset: gender_subj Matrix sum of S_male = 5409.0 Matrix sum of S_female = 6153.0

male_terms = ['he'] female_terms = ['she']

Dataset: gender_all Matrix sum of S_male = 2802.0 Matrix sum of S_female = 2802.0

Dataset: gender_subj Matrix sum of S_male = 2690.0 Matrix sum of S_female = 2603.0