search

juncongmoo / pyllama

LLaMA: Open and Efficient Foundation Language Models
GNU General Public License v3.0
2.8k stars 312 forks source link

Randomly get shape mismatch error #95

Open vedantroy opened 1 year ago

vedantroy commented 1 year ago

When doing inference, I randomly get the following error:

RuntimeError: The expanded size of the tensor (256) must match the existing size (287) at non-singleton dimension 0.  Target sizes: [256].  Tensor sizes: [287]