Open belle9217 opened 8 months ago
File "/slurmhome/qqq/.local/lib/python3.11/site-packages/transformers/models/llama/modeling_llama.py", line 333, in forward ^^^^^^^^^^^^^^^^^ File "/slurmhome/qqq/.local/lib/python3.11/site-packages/transformers/models/llama/modeling_llama.py", line 184, in apply_rotary_pos_emb query_states, key_states = apply_rotary_pos_emb(query_states, key_states, cos, sin, position_ids) cos = cos[position_ids].unsqueeze(1) # [bs, 1, seq_len, dim] ~ ~ ~^ ^ ^^ ^ ^^ ^^ ^ ^ ^^ ^
how to resolve the bug?thanks for your work.
File "/slurmhome/qqq/.local/lib/python3.11/site-packages/transformers/models/llama/modeling_llama.py", line 333, in forward ^^^^^^^^^^^^^^^^^ File "/slurmhome/qqq/.local/lib/python3.11/site-packages/transformers/models/llama/modeling_llama.py", line 184, in apply_rotary_pos_emb query_states, key_states = apply_rotary_pos_emb(query_states, key_states, cos, sin, position_ids) cos = cos[position_ids].unsqueeze(1) # [bs, 1, seq_len, dim] ~ ~ ~^ ^ ^^ ^ ^^ ^^ ^ ^ ^^ ^