search

nyu-mll / BBQ

Repository for the Bias Benchmark for QA dataset.
Creative Commons Attribution 4.0 International
84 stars 22 forks source link

Attested bias is missing #5

Open nikett opened 1 year ago

nikett commented 1 year ago

The paper shows a column of attested bias in addition to the source. The metadata contains the source but not the attested bias, where can I find that? In table 1 in the paper, the attested bias is not the title of the source but a paraphrase of it. @Alicia-Parrish @woollysocks

Elfsong commented 5 months ago

+1

Elfsong commented 5 months ago

@nikett Oh I found it at https://github.com/nyu-mll/BBQ/blob/main/supplemental/additional_metadata.csv

Elfsong commented 5 months ago

I created a new one on: https://huggingface.co/datasets/Elfsong/BBQ