search

BlinkDL / LM-Trick-Questions

Here we collect trick questions and failed tasks for open source LLMs to improve them.
Apache License 2.0
32 stars 2 forks source link

"Write a sentence using exactly n words" #6

Open Yuzabotov opened 1 year ago

Yuzabotov commented 1 year ago

Summary

It struggles to write a sentence using a specified number of words

Model version:

RWKV-4-Raven-7B-v10-Eng99%-Other1%-20230418-ctx8192

Example 1

Instruction: write a sentence using exactly 3 words Output: With great effort, the group succeeded in completing the project.

Example 2

Instruction: write a sentence using exactly 5 words Output: The room was filled with the scent of freshly cut flowers.

Example 3

Instruction: write a sentence using exactly 11 words Output: The sun rose in the east, casting a warm glow over the city.

Yuzabotov commented 1 year ago

Re-tested:

RWKV-4-Raven-7B-v11-Eng99%-Other1%-20230427-ctx8192 No noticeable difference