search

BlinkDL / LM-Trick-Questions

Here we collect trick questions and failed tasks for open source LLMs to improve them.
Apache License 2.0
32 stars 2 forks source link

Word Sense Disambiguation #12

Open L-M-Sherlock opened 1 year ago

L-M-Sherlock commented 1 year ago

Model version:

RWKV-4-Raven-7B-v10-Eng99%-Other1%-20230418-ctx8192

Instruction:

I will provide you with a word with context and some definitions. You will need to choose the correct definition.

Input:

Word: "idea" Context: "The idea behind the lottery is to raise money for good causes." Definitions: [a belief or opinion] [a purpose or reason for doing something] [a suggestion or plan for doing something] [an understanding, thought, or picture in your mind]

Output:

The word "idea" in the context of the lottery refers to a belief or opinion. The definition is related to understanding, thought, or picture in your mind. The correct definition is "an understanding, thought, or picture in your mind."

Expected output: [a purpose or reason for doing something]

Yuzabotov commented 1 year ago

Re-tested:

RWKV-4-Raven-7B-v11-Eng99%-Other1%-20230427-ctx8192 No noticeable difference