jquesnelle / yarn

YaRN: Efficient Context Window Extension of Large Language Models
MIT License
1.25k stars 111 forks source link

Error about eval/passkey.py #8

Closed Xnhyacinth closed 11 months ago

Xnhyacinth commented 11 months ago

/aten/src/ATen/native/cuda/IndexKernel.cu:92: operator(): block: [21,0,0], thread: [61,0,0] Assertion index >= -sizes[i] && index < sizes[i] && "index out of bounds" failed.

RuntimeError: CUDA error: device-side assert triggered CUDA kernel errors might be asynchronously reported at some other API call,so the stacktrace below might be incorrect. For debugging consider passing CUDA_LAUNCH_BLOCKING=1.

when I run the eval/passkey.py, then report the above error. how can I solve it