search

BlinkDL / LM-Trick-Questions

Here we collect trick questions and failed tasks for open source LLMs to improve them.
Apache License 2.0
32 stars 2 forks source link

Integer Multiplication #4

Open Yuzabotov opened 1 year ago

Yuzabotov commented 1 year ago

Summary

It struggles multiplying integers over 2-3 digits large

Model version:

RWKV-4-Raven-7B-v10-Eng99%-Other1%-20230418-ctx8192

Example 1

Instruction: what is 23*83 Output: 23 * 83 = 2089

Example 2

Instruction: what is 77*39 Output: 77 * 39 = 3993

Example 3

Instruction: what is 907*32 Output: 907 * 32 = 29504

Yuzabotov commented 1 year ago

Re-tested:

RWKV-4-Raven-7B-v11-Eng99%-Other1%-20230427-ctx8192 No noticeable difference