Closed QiaolingChen00 closed 1 year ago
@Chenqll Could you add a parameter --wall_clock_breakdown True
in your command for debugging then attach a full running log and your running environment information (e.g. package versions of transformers and pytorch). Thanks.
Hi. I face the same error when I try to run GPT. --wall_clock_breakdown True
doesn't make any meaningful difference, but print the structure of the model and return the same error.
I am using PyTorch 1.12.1 + CUDA 11.6, and Transformer 4.15.0.
@insujang Hi, thanks for using, we think it might be caused by this. Please try to downgrade PyTorch to 1.10, and we will try torch 1.12 very soon and fix it in next PR.
@lucasleesw Thanks for the quick response! I confirm that it successfully runs on old versions of PyTorch (tested 1.10.0 and 1.11.0) in my system.
RuntimeError: Tried to erase Node attention_mask_1 but it still had 1 users in the graph: {_assert_is_none: None}!
follow the
Merak/examples/language-modeling/README.md
,and use the command and did not change any code in merak:but had the following error: