BlinkDL / LM-Trick-Questions

Here we collect trick questions and failed tasks for open source LLMs to improve them.
Apache License 2.0
32 stars 2 forks source link

Puzzle #11

Open L-M-Sherlock opened 1 year ago

L-M-Sherlock commented 1 year ago

Model version:

RWKV-4-Raven-7B-v10-Eng99%-Other1%-20230418-ctx8192

Instruction:

To solve the puzzle.

Input:

A hunter walks one mile south, one mile east, and one mile north and ends up right back where he started. Where is the hunter on the earth?

Output:

The hunter is on the equator.

Expected output:

North Pole, or a circle around the South Pole with a radius of approximately 1 + 1/ 2π miles (1.16 miles) from the pole, you can start from any point within the circle. This means that your walk south will take you to very close to the South Pole, your walk east will take you on a complete circle around the pole, and your walk north will take you back where you started.

L-M-Sherlock commented 1 year ago

Here are a lot of puzzles: https://www.dailypuzzle.com/

Yuzabotov commented 1 year ago

Re-tested:

RWKV-4-Raven-7B-v11-Eng99%-Other1%-20230427-ctx8192 No noticeable difference