RuntimeError when executing run_knowedit_llama2.py

zjunlp / EasyEdit

[ACL 2024] An Easy-to-use Knowledge Editing Framework for LLMs.

https://zjunlp.github.io/project/KnowEdit

MIT License

1.82k stars 217 forks source link

RuntimeError when executing run_knowedit_llama2.py #286

Closed Leo-Lsc closed 4 months ago

Leo-Lsc commented 4 months ago

I got an error " ../easyeditor/util/generate.py", line 134, in generate_fast new_tok_indices = torch.multinomial(softmax_out_top_k, 1) RuntimeError: probability tensor contains either inf, nan or element < 0" when executing the script run_knowedit_llama2.py?

XeeKee commented 4 months ago

Could you provide more detailed information, such as the method you ran, the model used, and the hyperparameters, so that I can better assist you?

zxlzr commented 4 months ago

Hi, have you solved your issue yet?