tjunlp-lab / Awesome-LLMs-Evaluation-Papers

The papers are organized according to our survey: Evaluating Large Language Models: A Comprehensive Survey.
638 stars 41 forks source link

Negation Datasets #4

Closed ikergarcia1996 closed 8 months ago

ikergarcia1996 commented 8 months ago

Thank you for your work!

I thought that including some negation datasets would be interesting. Although large language models (LLMs) have apparently acquired a certain level of grammatical knowledge and the ability to make generalizations, they fail to interpret negation, a crucial step in Natural Language Processing. I have included some of the most relevant datasets tailored to evaluate LLMs understanding of negated sentences.

cordercorder commented 8 months ago

Thank you for your attention and for providing such an interesting research topic.