search

BlinkDL / LM-Trick-Questions

Here we collect trick questions and failed tasks for open source LLMs to improve them.
Apache License 2.0
32 stars 2 forks source link

Integer Addition #3

Open Yuzabotov opened 1 year ago

Yuzabotov commented 1 year ago

Summary

It struggles adding integers over 2-3 digits large

Model version:

RWKV-4-Raven-7B-v10-Eng99%-Other1%-20230418-ctx8192

Example 1

Instruction: what is 345+23 Output: 345 + 23 = 358

Example 2

Instruction: what is 325+754 Output: 859

Example 3

Instruction: what is 555+888 Output: 555 + 888 = 1353

Yuzabotov commented 1 year ago

Re-tested:

RWKV-4-Raven-7B-v11-Eng99%-Other1%-20230427-ctx8192 No noticeable difference