facebookresearch / belebele

Repo for the Belebele dataset, a massively multilingual reading comprehension dataset.
Other
306 stars 21 forks source link

Q2 inconsistency #5

Open pazars opened 9 months ago

pazars commented 9 months ago

In question 2 about accordion:

On the accordion, to get extra volume, you use the bellows with more pressure or speed.

The correct answer More speed relates to this part of the passage. ChatGPT using GPT-4 for me answered more pressure, which is also correct but is not in the choice list.

Also in Latvian (language with which I noticed this issue) the passage is incorrectly translated. It misses out on the comparison that one shouldn't press hard on the keys LIKE it is done on the piano. Rather it reads - like on the piano, one shouldn't press hard.